Sep 25 17:47:16 devstack cinder-volume[75651]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 17:47:16 devstack cinder-volume[75651]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:47:16 devstack cinder-volume[75651]: we strongly recommend against using it for new projects. Sep 25 17:47:16 devstack cinder-volume[75651]: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:47:16 devstack cinder-volume[75651]: framework. For more detail see Sep 25 17:47:16 devstack cinder-volume[75651]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:47:16 devstack cinder-volume[75651]: import eventlet # noqa Sep 25 17:47:19 devstack cinder-volume[75651]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:47:19 devstack cinder-volume[75651]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:47:19 devstack cinder-volume[75651]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:47:20 devstack cinder-volume[75651]: INFO dbcounter [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Registered counter for database cinder Sep 25 17:47:20 devstack cinder-volume[75651]: DEBUG oslo_db.sqlalchemy.engines [None req-fff55018-0045-47b3-9e89-057108131c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:47:20 devstack cinder-volume[75651]: DEBUG dbcounter [-] [75651] Writer thread running {{(pid=75651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:47:20 devstack cinder-volume[75651]: INFO cinder.rpc [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 17:47:20 devstack cinder-volume[75651]: INFO cinder.rpc [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 17:47:20 devstack cinder-volume[75651]: DEBUG oslo_db.sqlalchemy.engines [None req-fff55018-0045-47b3-9e89-057108131c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:47:20 devstack cinder-volume[75651]: INFO cinder.volume.manager [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Determined volume DB was empty at startup. Sep 25 17:47:20 devstack cinder-volume[75651]: DEBUG cinder.volume.manager [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75651) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 17:47:20 devstack cinder-volume[75651]: INFO cinder.volume.manager [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 17:47:20 devstack cinder-volume[75651]: WARNING stevedore.named [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:47:20 devstack cinder-volume[75651]: WARNING castellan.key_manager [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:47:20 devstack cinder-volume[75651]: WARNING cinder.keymgr.conf_key_mgr [None req-fff55018-0045-47b3-9e89-057108131c2a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:47:20 devstack cinder-volume[75651]: DEBUG cinder.volume.drivers.lvm [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75651) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 17:47:20 devstack cinder-volume[75651]: DEBUG oslo_concurrency.processutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_concurrency.processutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] CMD "cinder-rtstool verify" returned: 0 in 0.484s {{(pid=75651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_db.sqlalchemy.engines [None req-fff55018-0045-47b3-9e89-057108131c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:47:21 devstack cinder-volume[75651]: INFO cinder.rpc [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 17:47:21 devstack cinder-volume[75651]: INFO cinder.rpc [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 17:47:21 devstack cinder-volume[75651]: WARNING stevedore.named [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:47:21 devstack cinder-volume[75651]: WARNING castellan.key_manager [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:47:21 devstack cinder-volume[75651]: INFO cinder.volume.manager [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_db.sqlalchemy.engines [None req-fff55018-0045-47b3-9e89-057108131c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:47:21 devstack cinder-volume[75651]: INFO oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Starting 1 workers Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Started child 75804 {{(pid=75651) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Full set of CONF: {{(pid=75651) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] ******************************************************************************** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Configuration options gathered from: {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] ================================================================================ {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] allow_availability_zone_fallback = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] allow_compression_on_image_upload = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] allowed_direct_url_schemes = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] api_rate_limit = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] auth_strategy = keystone {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] az_cache_duration = 3600 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_availability_zone = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_host = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_stats_polling_interval = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backup_api_class = cinder.backup.api.API {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backup_name_template = backup-%s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backup_use_same_host = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backup_use_temp_snapshot = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] chap_password = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] chap_username = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_internal_tenant_project_id = 8d26b79967a8421893d3c05bcbd96187 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_internal_tenant_user_id = 973e1039a0ee45d9b7d973775d651995 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cloned_volume_same_az = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cluster = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75804]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] compression_format = gzip {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] compute_api_class = cinder.compute.nova.API {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] config_dir = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] config_source = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] control_exchange = openstack {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] debug = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] default_availability_zone = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] default_group_type = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] default_volume_type = lvmdriver-1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] disk_geometry = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] driver_client_cert = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] driver_client_cert_key = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] driver_data_namespace = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] driver_ssl_cert_path = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] driver_ssl_cert_verify = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] driver_use_ssl = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] enable_force_upload = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] enable_new_services = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] enable_unsupported_driver = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] enforce_multipath_for_image_xfer = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] filter_function = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_api_insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_api_ssl_compression = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_ca_certificates_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_catalog_info = image:glance:publicURL {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_num_retries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance_request_timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] goodness_function = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] graceful_shutdown_timeout = 5 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] group_api_class = cinder.group.api.API {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] host = devstack {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_compress_on_upload = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_conversion_address_space_limit = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_conversion_cpu_limit = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_conversion_disable = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_introspection_address_space_limit = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_introspection_cpu_limit = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_upload_use_cinder_backend = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_upload_use_internal_tenant = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_volume_cache_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_volume_cache_max_count = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] image_volume_cache_max_size_gb = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] init_host_max_objects_retrieval = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] instance_format = [instance: %(uuid)s] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] iscsi_target_flags = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] iscsi_write_cache = on {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] iser_helper = tgtadm {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] iser_ip_address = 192.168.122.218 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] iser_port = 3260 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_color = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_config_append = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_dir = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_options = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_rotate_interval = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_rotate_interval_type = days {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] log_rotation_type = none {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] max_age = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] max_logfile_count = 30 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] max_logfile_size_mb = 200 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] max_over_subscription_ratio = 20.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] message_reap_interval = 86400 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] message_ttl = 2592000 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] migration_create_volume_timeout_secs = 300 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] monkey_patch = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] monkey_patch_modules = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] my_ip = 192.168.122.218 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] no_snapshot_gb_quota = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] num_iser_scan_tries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] num_shell_tries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] num_volume_device_scan_tries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] nvmeof_conn_info_version = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] nvmet_ns_id = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] nvmet_port_id = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_max_limit = 1000 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_volume_ext_list = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_volume_listen_port = 8776 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_volume_use_ssl = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] osapi_volume_workers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] per_volume_size_limit = -1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] periodic_fuzzy_delay = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] periodic_interval = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] public_endpoint = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] publish_errors = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_backup_gigabytes = 1000 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_backups = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_gigabytes = 1000 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_groups = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_snapshots = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] quota_volumes = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] rate_limit_burst = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] rate_limit_except_level = CRITICAL {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] rate_limit_interval = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] reinit_driver_count = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] replication_device = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] report_discard_supported = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] report_interval = 120 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] reservation_clean_interval = 86400 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] reservation_expire = 86400 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] reserved_image_namespaces = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] reserved_percentage = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] rpc_response_timeout = 120 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] run_external_periodic_tasks = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] scst_target_driver = iscsi {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] scst_target_iqn_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_down_time = 720 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] shell_completion = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] snapshot_name_template = snapshot-%s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] snapshot_same_host = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] split_loggers = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] state_path = /opt/stack/data/cinder {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] storage_availability_zone = nova {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] storage_protocol = iSCSI {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] syslog_log_facility = LOG_USER {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] target_helper = lioadm {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] target_ip_address = 192.168.122.218 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] target_port = 3260 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] target_protocol = iscsi {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] target_secondary_ip_addresses = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] trace_flags = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] transport_url = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] until_refresh = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_chap_auth = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_default_quota_class = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_journal = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_json = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_multipath_for_image_xfer = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_stderr = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] use_syslog = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] verify_glance_signatures = enabled {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_api_class = cinder.volume.api.API {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_backend_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_clear = zero {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_clear_ionice = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_clear_size = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_copy_bps_limit = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_dd_blocksize = 1M {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_name_template = volume-%s {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_service_inithost_offload = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volume_usage_audit_period = month {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] zoning_mode = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_concurrency.disable_process_locking = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.auth_section = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.auth_type = password {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.auth_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.cache = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.include_service_catalog = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.interface = public {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_password = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcache_username = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.region_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.service_token_roles_required = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.service_type = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.backend = dogpile.cache.null {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.backend_argument = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.backend_expiration_time = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.config_prefix = cache.oslo {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.debug_cache_backend = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.enable_retry_client = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.enable_socket_keepalive = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.expiration_time = 600 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.hashclient_retry_attempts = 2 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_dead_retry = 300 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_pool_maxsize = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_sasl_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.password = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.proxies = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.redis_db = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.redis_server = localhost:6379 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.retry_attempts = 2 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.retry_delay = 0.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.socket_keepalive_count = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.socket_keepalive_idle = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.socket_keepalive_interval = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.socket_timeout = 1.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.tls_allowed_ciphers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.tls_cafile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.tls_certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.tls_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.tls_keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cache.username = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] coordination.backend_url = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.asyncio_connection = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.asyncio_slave_connection = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.backend = sqlalchemy {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.connection = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.connection_debug = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.connection_parameters = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.connection_recycle_time = 3600 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.connection_trace = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.db_inc_retry_interval = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.db_max_retries = 20 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.db_max_retry_interval = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.db_retry_interval = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.max_overflow = 50 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.max_pool_size = 5 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.max_retries = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.mysql_wsrep_sync_wait = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.pool_timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.retry_interval = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.slave_connection = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.sqlite_synchronous = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.synchronous_reader = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] database.use_db_reconnect = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_tracing.insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.connection_string = messaging:// {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.es_doc_type = notification {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.es_scroll_size = 10000 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.es_scroll_time = 2m {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.filter_error_trace = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.hmac_keys = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.sentinel_service_name = mymaster {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.socket_timeout = 0.1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.trace_requests = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler.trace_sqlalchemy = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler_jaeger.process_tags = {} {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler_jaeger.service_name_prefix = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] profiler_otlp.service_name_prefix = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.enforce_new_defaults = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.policy_default_rule = default {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.policy_file = policy.yaml {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.group = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.helper_command = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] privsep_osbrick.user = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.group = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.helper_command = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] cinder_sys_admin.user = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.auth_section = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.auth_type = password {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.cafile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.collect_timing = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.send_service_user_token = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.split_loggers = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.tls_ciphers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] service_user.tls_min_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.auth_section = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.auth_type = password {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.collect_timing = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.region_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.split_loggers = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.tls_ciphers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] glance.tls_min_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.backend_availability_zone = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.chap_password = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.chap_username = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.disk_geometry = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.driver_client_cert = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.driver_client_cert_key = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.driver_data_namespace = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.driver_use_ssl = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.extra_capabilities = {} {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.filter_function = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.goodness_function = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.iscsi_target_flags = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.iscsi_write_cache = on {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.iser_helper = tgtadm {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.iser_port = 3260 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.lvm_share_target = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.lvm_type = auto {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.num_shell_tries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.replication_device = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.report_discard_supported = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.reserved_percentage = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.target_helper = tgtadm {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.target_port = 3260 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.target_protocol = iscsi {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.trace_flags = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.unique_fqdn_network = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.use_chap_auth = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_backend_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_clear = zero {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_clear_ionice = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_clear_size = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_reports.file_event_handler = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_reports.log_dir = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.backend_host = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.chap_password = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.chap_username = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.disk_geometry = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.driver_client_cert = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.extra_capabilities = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.filter_function = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.goodness_function = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.iser_helper = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.iser_ip_address = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.iser_port = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.lvm_share_target = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.lvm_type = auto {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.num_shell_tries = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.replication_device = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.report_discard_supported = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.reserved_percentage = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.scst_target_driver = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.storage_protocol = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.target_helper = lioadm {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.target_ip_address = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.target_port = 3260 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.trace_flags = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.use_chap_auth = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_clear = zero {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack sudo[75808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_clear_size = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack sudo[75808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] lvmdriver-1.volumes_dir = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_notifications.driver = [] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_notifications.retry = -1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] key_manager.fixed_key = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.barbican_api_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.barbican_endpoint = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.barbican_endpoint_type = public {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.barbican_region_name = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.cafile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.collect_timing = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.number_of_retries = 60 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.retry_delay = 1 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.send_service_user_token = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.split_loggers = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.tls_ciphers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.tls_min_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.verify_ssl = True {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican.verify_ssl_path = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.auth_section = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.auth_type = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.cafile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.certfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.collect_timing = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.insecure = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.keyfile = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.split_loggers = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.timeout = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.tls_ciphers = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] barbican_service_user.tls_min_version = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.approle_role_id = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.approle_secret_id = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.auth_method = approle {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.auth_path = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.kv_mountpoint = secret {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.kv_path = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.kv_version = 2 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.namespace = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.root_token_id = **** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.ssl_ca_crt_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.timeout = 60.0 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.token_file = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.token_role = None {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.use_ssl = False {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:47:21 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] ******************************************************************************** {{(pid=75651) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 17:47:21 devstack sudo[75808]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:21 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:21 devstack sudo[75944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:21 devstack sudo[75944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:22 devstack sudo[75944]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.271s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:47:22 devstack cinder-volume[75804]: INFO cinder.brick.local_dev.lvm [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:22 devstack sudo[76037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:47:22 devstack sudo[76037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:22 devstack sudo[76037]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG cinder.brick.local_dev.lvm [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75804) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:22 devstack sudo[76119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:22 devstack sudo[76119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:22 devstack sudo[76119]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:22 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:23 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:23 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:23 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:23 devstack sudo[76412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 17:47:23 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:23 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.282s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:23 devstack sudo[76415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:47:23 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:23 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:24 devstack sudo[76498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:47:24 devstack sudo[76498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:24 devstack sudo[76498]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:24 devstack sudo[76501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:24 devstack sudo[76501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:24 devstack sudo[76501]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:24 devstack sudo[76566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:24 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:24 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:24 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:24 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:24 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:25 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:25 devstack cinder-volume[75804]: INFO cinder.volume.drivers.lvm [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:25 devstack sudo[76605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:25 devstack sudo[76605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:25 devstack sudo[76605]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:25 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:47:25 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:25 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:25 devstack sudo[76611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:25 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:25 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:25 devstack sudo[76614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:25 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:26 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:26 devstack sudo[76617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:26 devstack sudo[76617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:26 devstack sudo[76617]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:26 devstack cinder-volume[75804]: INFO cinder.volume.driver [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG cinder.volume.driver [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75804) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_db.sqlalchemy.engines [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writer thread running {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG cinder.db.api [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Building query based on filter {{(pid=75804) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG cinder.image.image_utils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75804) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:47:26 devstack cinder-volume[75804]: INFO cinder.keymgr.migration [None req-8c82a815-d463-4238-8d24-9c4e7527c26c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:26 devstack sudo[76621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:47:26 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:26 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:26 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:26 devstack sudo[76626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:26 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:27 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:27 devstack sudo[76629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:27 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:27 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:27 devstack sudo[76632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:27 devstack sudo[76632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:27 devstack sudo[76632]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:47:27 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Driver initialization completed successfully. Sep 25 17:47:27 devstack cinder-volume[75804]: INFO cinder.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Initiating service 2 cleanup Sep 25 17:47:27 devstack cinder-volume[75804]: INFO cinder.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Service 2 cleanup completed. Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG cinder.service [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Creating RPC server for service cinder-volume {{(pid=75804) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG cinder.service [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75804) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:47:27 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:47:27 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:27 devstack sudo[76635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:47:27 devstack sudo[76635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:28 devstack sudo[76635]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:28 devstack sudo[76640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:28 devstack sudo[76640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:28 devstack sudo[76640]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:28 devstack sudo[76646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:47:28 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:28 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:47:28 devstack sudo[76649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:47:28 devstack sudo[76649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:47:28 devstack sudo[76649]: pam_unix(sudo:session): session closed for user root Sep 25 17:47:28 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:47:28 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-8eceb394-4e44-4cd6-b1e1-6a4baf9407ba None None] Driver post RPC initialization completed successfully. Sep 25 17:47:31 devstack cinder-volume[75651]: DEBUG dbcounter [-] [75651] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:47:38 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=4 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:47:39 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:48:09 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running periodic task VolumeManager._thread_info {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:48:09 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] thread count: 6 {{(pid=75804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:48:09 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] thread info: [<_MainThread(MainThread, started 130364810813568)>, , , , , ] {{(pid=75804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:49:09 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:49:09 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:49:09 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:49:10 devstack sudo[81875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:49:10 devstack sudo[81875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:49:10 devstack sudo[81875]: pam_unix(sudo:session): session closed for user root Sep 25 17:49:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:49:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:49:10 devstack sudo[81878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:49:10 devstack sudo[81878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:49:10 devstack sudo[81878]: pam_unix(sudo:session): session closed for user root Sep 25 17:49:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:49:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:49:10 devstack sudo[81881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:49:10 devstack sudo[81881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:49:10 devstack sudo[81881]: pam_unix(sudo:session): session closed for user root Sep 25 17:49:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:49:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:49:10 devstack sudo[81884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:49:10 devstack sudo[81884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:49:11 devstack sudo[81884]: pam_unix(sudo:session): session closed for user root Sep 25 17:49:11 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:49:11 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:49:11 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running periodic task VolumeManager._thread_info {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:49:11 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] thread count: 6 {{(pid=75804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:49:11 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] thread info: [<_MainThread(MainThread, started 130364810813568)>, , , , , ] {{(pid=75804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:49:38 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:49:38 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:50:09 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:50:09 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:50:09 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:50:10 devstack sudo[83375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:50:10 devstack sudo[83375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:50:10 devstack sudo[83375]: pam_unix(sudo:session): session closed for user root Sep 25 17:50:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:50:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:50:10 devstack sudo[83378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:50:10 devstack sudo[83378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:50:10 devstack sudo[83378]: pam_unix(sudo:session): session closed for user root Sep 25 17:50:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:50:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:50:10 devstack sudo[83381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:50:10 devstack sudo[83381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:50:10 devstack sudo[83381]: pam_unix(sudo:session): session closed for user root Sep 25 17:50:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:50:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:50:10 devstack sudo[83408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:50:10 devstack sudo[83408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:50:11 devstack sudo[83408]: pam_unix(sudo:session): session closed for user root Sep 25 17:50:11 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:50:11 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:51:09 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:51:09 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Updating volume stats {{(pid=75804) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 17:51:09 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:51:10 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 17:51:10 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:51:10 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Sep 25 17:51:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:51:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:51:10 devstack sudo[84876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:51:10 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:51:10 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root Sep 25 17:51:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:51:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:51:10 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 17:51:10 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:51:10 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Sep 25 17:51:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:51:10 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:51:10 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 17:51:10 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:51:11 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Sep 25 17:51:11 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:51:11 devstack cinder-volume[75804]: DEBUG cinder.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Notifying Schedulers of capabilities ... {{(pid=75804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:51:11 devstack cinder-volume[75804]: DEBUG oslo_service.periodic_task [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] Running periodic task VolumeManager._thread_info {{(pid=75804) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:51:11 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] thread count: 6 {{(pid=75804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:51:11 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-4d9c740b-4947-47b7-919a-65c6eaba7b8d None None] thread info: [<_MainThread(MainThread, started 130364810813568)>, , , , , ] {{(pid=75804) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:51:38 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:51:38 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:51:54 devstack cinder-volume[75651]: INFO oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Caught SIGTERM, stopping children Sep 25 17:51:54 devstack cinder-volume[75651]: DEBUG oslo_concurrency.lockutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Acquiring lock "singleton_lock" {{(pid=75651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:51:54 devstack cinder-volume[75651]: DEBUG oslo_concurrency.lockutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Acquired lock "singleton_lock" {{(pid=75651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:51:54 devstack cinder-volume[75651]: DEBUG oslo_concurrency.lockutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Releasing lock "singleton_lock" {{(pid=75651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:51:54 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Stop services. {{(pid=75651) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 17:51:54 devstack cinder-volume[75651]: DEBUG oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Killing children. {{(pid=75651) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 17:51:54 devstack cinder-volume[75651]: INFO oslo_service.backend._eventlet.service [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Waiting on 1 children to exit Sep 25 17:51:59 devstack cinder-volume[75804]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 17:52:00 devstack cinder-volume[85815]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 17:52:00 devstack cinder-volume[85815]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:52:00 devstack cinder-volume[85815]: we strongly recommend against using it for new projects. Sep 25 17:52:00 devstack cinder-volume[85815]: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:52:00 devstack cinder-volume[85815]: framework. For more detail see Sep 25 17:52:00 devstack cinder-volume[85815]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:52:00 devstack cinder-volume[85815]: import eventlet # noqa Sep 25 17:52:02 devstack cinder-volume[85815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:52:02 devstack cinder-volume[85815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:52:02 devstack cinder-volume[85815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:52:02 devstack cinder-volume[85815]: INFO dbcounter [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Registered counter for database cinder Sep 25 17:52:02 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Acquiring lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:52:02 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Acquired lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:52:02 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Releasing lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:52:02 devstack cinder-volume[75804]: WARNING amqp [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:52:02 devstack cinder-volume[85815]: DEBUG oslo_db.sqlalchemy.engines [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:02 devstack cinder-volume[75804]: WARNING amqp [None req-fff55018-0045-47b3-9e89-057108131c2a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG dbcounter [-] [85815] Writer thread running {{(pid=85815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:52:03 devstack cinder-volume[85815]: INFO cinder.rpc [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 17:52:03 devstack cinder-volume[85815]: INFO cinder.rpc [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_db.sqlalchemy.engines [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:03 devstack cinder-volume[85815]: INFO cinder.volume.manager [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Determined volume DB was empty at startup. Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG cinder.volume.manager [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85815) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 17:52:03 devstack cinder-volume[85815]: INFO cinder.volume.manager [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 17:52:03 devstack cinder-volume[85815]: WARNING stevedore.named [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:52:03 devstack cinder-volume[85815]: WARNING castellan.key_manager [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:52:03 devstack cinder-volume[85815]: WARNING cinder.keymgr.conf_key_mgr [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:52:03 devstack cinder-volume[85815]: INFO cinder.volume.manager [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_db.sqlalchemy.engines [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:03 devstack cinder-volume[85815]: INFO oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Starting 1 workers Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Started child 86036 {{(pid=85815) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Full set of CONF: {{(pid=85815) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] ******************************************************************************** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Configuration options gathered from: {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] ================================================================================ {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] allow_availability_zone_fallback = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] allow_compression_on_image_upload = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] allowed_direct_url_schemes = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] api_rate_limit = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] auth_strategy = keystone {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_availability_zone = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_host = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_stats_polling_interval = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backup_api_class = cinder.backup.api.API {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backup_name_template = backup-%s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backup_use_same_host = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backup_use_temp_snapshot = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] chap_password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] chap_username = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[86036]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_internal_tenant_project_id = 8d26b79967a8421893d3c05bcbd96187 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_internal_tenant_user_id = 973e1039a0ee45d9b7d973775d651995 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cluster = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] compression_format = gzip {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] compute_api_class = cinder.compute.nova.API {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] config_dir = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] config_source = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] control_exchange = openstack {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] debug = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] default_availability_zone = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] default_group_type = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] default_volume_type = QuobyteHD {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] disk_geometry = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] driver_client_cert = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] driver_client_cert_key = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] driver_data_namespace = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] driver_ssl_cert_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] driver_ssl_cert_verify = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] driver_use_ssl = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] enable_new_services = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] enable_unsupported_driver = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] enabled_backends = ['QuobyteHD'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] enforce_multipath_for_image_xfer = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] filter_function = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_api_insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_api_ssl_compression = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_ca_certificates_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_catalog_info = image:glance:publicURL {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_num_retries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance_request_timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] goodness_function = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] graceful_shutdown_timeout = 5 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] group_api_class = cinder.group.api.API {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] host = devstack {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_compress_on_upload = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_conversion_address_space_limit = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_conversion_cpu_limit = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_conversion_disable = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_introspection_address_space_limit = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_introspection_cpu_limit = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_upload_use_cinder_backend = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_upload_use_internal_tenant = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_volume_cache_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_volume_cache_max_count = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] image_volume_cache_max_size_gb = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] init_host_max_objects_retrieval = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] instance_format = [instance: %(uuid)s] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] iscsi_target_flags = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] iscsi_write_cache = on {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] iser_helper = tgtadm {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] iser_ip_address = 192.168.122.218 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] iser_port = 3260 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_color = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_config_append = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_dir = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_options = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_rotate_interval = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_rotate_interval_type = days {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] log_rotation_type = none {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] max_age = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] max_logfile_count = 30 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] max_logfile_size_mb = 200 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] max_over_subscription_ratio = 20.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] message_reap_interval = 86400 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] message_ttl = 2592000 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] migration_create_volume_timeout_secs = 300 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] monkey_patch = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] monkey_patch_modules = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] my_ip = 192.168.122.218 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] no_snapshot_gb_quota = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] num_iser_scan_tries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] num_shell_tries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] num_volume_device_scan_tries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] nvmeof_conn_info_version = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] nvmet_ns_id = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] nvmet_port_id = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_max_limit = 1000 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_volume_ext_list = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_volume_listen_port = 8776 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_volume_use_ssl = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] osapi_volume_workers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] per_volume_size_limit = -1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] periodic_fuzzy_delay = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] periodic_interval = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] public_endpoint = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] publish_errors = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_backup_gigabytes = 1000 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_backups = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_gigabytes = 1000 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_groups = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_snapshots = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] quota_volumes = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] rate_limit_burst = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] rate_limit_except_level = CRITICAL {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] rate_limit_interval = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] reinit_driver_count = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] replication_device = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] report_discard_supported = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] report_interval = 120 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] reservation_clean_interval = 86400 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] reservation_expire = 86400 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] reserved_image_namespaces = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] reserved_percentage = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] rpc_response_timeout = 120 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] run_external_periodic_tasks = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] scst_target_driver = iscsi {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] scst_target_iqn_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_down_time = 720 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] shell_completion = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] snapshot_name_template = snapshot-%s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] split_loggers = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] state_path = /opt/stack/data/cinder {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] storage_availability_zone = nova {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] storage_protocol = iSCSI {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] syslog_log_facility = LOG_USER {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] target_helper = lioadm {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] target_ip_address = 192.168.122.218 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] target_port = 3260 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] target_protocol = iscsi {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] target_secondary_ip_addresses = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] trace_flags = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] transport_url = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[86036]: INFO cinder.volume.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] until_refresh = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.remotefs [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86036) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_chap_auth = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_default_quota_class = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_journal = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_json = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_multipath_for_image_xfer = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_stderr = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] use_syslog = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] verify_glance_signatures = enabled {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_api_class = cinder.volume.api.API {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_backend_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_clear = zero {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_clear_ionice = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_clear_size = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_copy_bps_limit = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_dd_blocksize = 1M {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_name_template = volume-%s {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_service_inithost_offload = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volume_usage_audit_period = month {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] zoning_mode = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_concurrency.disable_process_locking = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.auth_section = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.auth_type = password {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.auth_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.cache = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.include_service_catalog = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.interface = public {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcache_username = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.region_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.service_type = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.backend = dogpile.cache.null {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.backend_argument = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.backend_expiration_time = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.config_prefix = cache.oslo {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.debug_cache_backend = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.enable_retry_client = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.enable_socket_keepalive = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.expiration_time = 600 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.hashclient_retry_attempts = 2 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_dead_retry = 300 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_pool_maxsize = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_sasl_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.proxies = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.redis_db = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.redis_server = localhost:6379 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.retry_attempts = 2 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.retry_delay = 0.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.socket_keepalive_count = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.socket_keepalive_idle = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.socket_keepalive_interval = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.socket_timeout = 1.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.tls_allowed_ciphers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.tls_cafile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.tls_certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.tls_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.tls_keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cache.username = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] coordination.backend_url = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.asyncio_connection = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.asyncio_slave_connection = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.backend = sqlalchemy {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.connection = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.connection_debug = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.connection_parameters = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.connection_recycle_time = 3600 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.connection_trace = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.db_inc_retry_interval = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.db_max_retries = 20 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.db_max_retry_interval = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.db_retry_interval = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.max_overflow = 50 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.max_pool_size = 5 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.max_retries = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.mysql_wsrep_sync_wait = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.pool_timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.retry_interval = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.slave_connection = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.sqlite_synchronous = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.synchronous_reader = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] database.use_db_reconnect = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_tracing.insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.connection_string = messaging:// {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.es_doc_type = notification {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.es_scroll_size = 10000 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.es_scroll_time = 2m {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.filter_error_trace = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.hmac_keys = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.sentinel_service_name = mymaster {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.socket_timeout = 0.1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.trace_requests = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler.trace_sqlalchemy = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler_jaeger.process_tags = {} {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler_jaeger.service_name_prefix = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] profiler_otlp.service_name_prefix = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.enforce_new_defaults = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.policy_default_rule = default {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.policy_file = policy.yaml {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.group = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.helper_command = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] privsep_osbrick.user = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.group = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.helper_command = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] cinder_sys_admin.user = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.auth_section = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.auth_type = password {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.cafile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.collect_timing = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.send_service_user_token = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.split_loggers = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.tls_ciphers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] service_user.tls_min_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.auth_section = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.auth_type = password {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.collect_timing = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.region_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.split_loggers = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.tls_ciphers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] glance.tls_min_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.backend_availability_zone = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.chap_password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.chap_username = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.disk_geometry = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.driver_client_cert = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.driver_client_cert_key = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.driver_data_namespace = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.driver_use_ssl = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.extra_capabilities = {} {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.filter_function = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.goodness_function = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.iscsi_target_flags = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.iscsi_write_cache = on {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.iser_helper = tgtadm {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.iser_port = 3260 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_host = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_login = admin {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_mount_options = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_private_key = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_share_path = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.num_shell_tries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.quobyte_volume_url = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.replication_device = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.report_discard_supported = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.reserved_percentage = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.target_helper = tgtadm {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.target_port = 3260 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.target_protocol = iscsi {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.trace_flags = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.unique_fqdn_network = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.use_chap_auth = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_backend_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_clear = zero {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_clear_ionice = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_clear_size = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_reports.file_event_handler = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_reports.log_dir = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.backend_availability_zone = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.backend_host = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.chap_password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86036) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 17:52:03 devstack cinder-volume[86036]: WARNING cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 17:52:03 devstack cinder-volume[86036]: WARNING cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Running cmd (subprocess): mount.quobyte {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.chap_username = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.chiscsi_conf = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.disk_geometry = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.driver_client_cert = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.driver_data_namespace = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.driver_use_ssl = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.extra_capabilities = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.filter_function = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.goodness_function = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.iser_helper = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.iser_ip_address = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.iser_port = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.iser_target_prefix = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_host = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_login = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_mount_options = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_password = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_private_key = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_share_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_ssh_port = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.num_shell_tries = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.nvmet_port_id = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.replication_device = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.report_discard_supported = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.reserved_percentage = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.scst_target_driver = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.storage_protocol = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.target_helper = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.target_ip_address = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.target_port = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.target_prefix = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.target_protocol = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.trace_flags = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.use_chap_auth = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_clear = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_clear_size = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] QuobyteHD.volumes_dir = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack quobyte-client[86041]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 17:52:03 devstack quobyte-client[86041]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_notifications.driver = [] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: INFO cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 ... Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_notifications.retry = -1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] key_manager.fixed_key = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.barbican_api_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 -c /etc/quobyte/client-cinder.cfg {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.barbican_endpoint = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.barbican_endpoint_type = public {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.barbican_region_name = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.cafile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.collect_timing = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.number_of_retries = 60 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.retry_delay = 1 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.send_service_user_token = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.split_loggers = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.tls_ciphers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.tls_min_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.verify_ssl = True {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican.verify_ssl_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.auth_section = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.auth_type = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.cafile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.certfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.collect_timing = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.insecure = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.keyfile = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.split_loggers = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.timeout = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.tls_ciphers = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] barbican_service_user.tls_min_version = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.approle_role_id = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.approle_secret_id = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.auth_method = approle {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.auth_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.kv_mountpoint = secret {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.kv_path = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.kv_version = 2 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.namespace = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.root_token_id = **** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.ssl_ca_crt_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.timeout = 60.0 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.token_file = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.token_role = None {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.use_ssl = False {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:03 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] ******************************************************************************** {{(pid=85815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 17:52:03 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 -c /etc/quobyte/client-cinder.cfg Sep 25 17:52:03 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:04 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.419s {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:04 devstack cinder-volume[86036]: INFO cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 succeeded Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.434s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:04 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:04 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:04 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.257s {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:04 devstack cinder-volume[86036]: INFO cinder.volume.driver [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG cinder.volume.driver [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2857971191406, 'free_capacity_gb': 1775.2857971191406, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86036) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_db.sqlalchemy.engines [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG dbcounter [-] [86036] Writer thread running {{(pid=86036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG cinder.db.api [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Building query based on filter {{(pid=86036) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG cinder.image.image_utils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86036) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:52:04 devstack cinder-volume[86036]: INFO cinder.keymgr.migration [None req-f0d5211f-4c60-4ff5-8bf5-602b02c76b59 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:04 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:04 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:04 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:05 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.247s {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG cinder.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Notifying Schedulers of capabilities ... {{(pid=86036) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:52:05 devstack cinder-volume[86036]: INFO cinder.volume.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Driver initialization completed successfully. Sep 25 17:52:05 devstack cinder-volume[86036]: INFO cinder.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Initiating service 3 cleanup Sep 25 17:52:05 devstack cinder-volume[86036]: INFO cinder.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Service 3 cleanup completed. Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG cinder.service [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Creating RPC server for service cinder-volume {{(pid=86036) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG cinder.service [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86036) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:52:05 devstack cinder-volume[86036]: INFO cinder.volume.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:05 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:05 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:05 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:05 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.274s {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:05 devstack cinder-volume[86036]: INFO cinder.volume.manager [None req-741a9652-595c-4e2e-a7d0-16869066e91c None None] Driver post RPC initialization completed successfully. Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86036) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:10 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:10 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:10 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG oslo_concurrency.processutils [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.242s {{(pid=86036) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:10 devstack cinder-volume[86036]: DEBUG cinder.manager [None req-c1a5bc84-2e3d-4230-9df5-991fee90e53b None None] Notifying Schedulers of capabilities ... {{(pid=86036) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:52:12 devstack cinder-volume[85815]: INFO oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Caught SIGTERM, stopping children Sep 25 17:52:12 devstack cinder-volume[85815]: DEBUG oslo_concurrency.lockutils [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Acquiring lock "singleton_lock" {{(pid=85815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:52:12 devstack cinder-volume[85815]: DEBUG oslo_concurrency.lockutils [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Acquired lock "singleton_lock" {{(pid=85815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:52:12 devstack cinder-volume[85815]: DEBUG oslo_concurrency.lockutils [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Releasing lock "singleton_lock" {{(pid=85815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:52:12 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Stop services. {{(pid=85815) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 17:52:12 devstack cinder-volume[85815]: DEBUG oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Killing children. {{(pid=85815) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 17:52:12 devstack cinder-volume[85815]: INFO oslo_service.backend._eventlet.service [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Waiting on 1 children to exit Sep 25 17:52:15 devstack cinder-volume[86036]: DEBUG dbcounter [-] [86036] Writing DB stats cinder:SELECT=4 {{(pid=86036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:52:15 devstack cinder-volume[86036]: DEBUG dbcounter [-] [86036] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:52:17 devstack cinder-volume[86036]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 17:52:17 devstack cinder-volume[86379]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 17:52:17 devstack cinder-volume[86379]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:52:17 devstack cinder-volume[86379]: we strongly recommend against using it for new projects. Sep 25 17:52:17 devstack cinder-volume[86379]: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:52:17 devstack cinder-volume[86379]: framework. For more detail see Sep 25 17:52:17 devstack cinder-volume[86379]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:52:17 devstack cinder-volume[86379]: import eventlet # noqa Sep 25 17:52:18 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Acquiring lock "singleton_lock" {{(pid=86036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:52:18 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Acquired lock "singleton_lock" {{(pid=86036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:52:18 devstack cinder-volume[86036]: DEBUG oslo_concurrency.lockutils [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Releasing lock "singleton_lock" {{(pid=86036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:52:18 devstack cinder-volume[86036]: WARNING amqp [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:52:18 devstack cinder-volume[86036]: WARNING amqp [None req-32afa456-5997-4768-997e-aa88c8dcd891 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:52:20 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:52:20 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:52:20 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:52:20 devstack cinder-volume[86379]: INFO dbcounter [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Registered counter for database cinder Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG dbcounter [-] [86379] Writer thread running {{(pid=86379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:52:21 devstack cinder-volume[86379]: INFO cinder.rpc [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 17:52:21 devstack cinder-volume[86379]: INFO cinder.rpc [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:21 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Determined volume DB was empty at startup. Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG cinder.volume.manager [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86379) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 17:52:21 devstack cinder-volume[86379]: WARNING stevedore.named [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:52:21 devstack cinder-volume[86379]: WARNING castellan.key_manager [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:52:21 devstack cinder-volume[86379]: WARNING cinder.keymgr.conf_key_mgr [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:52:21 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:21 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Starting 1 workers Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Started child 86665 {{(pid=86379) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Full set of CONF: {{(pid=86379) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] Configuration options gathered from: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 17:52:21 devstack cinder-volume[86665]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] ================================================================================ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] allow_availability_zone_fallback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] allow_compression_on_image_upload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] allowed_direct_url_schemes = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] api_rate_limit = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] auth_strategy = keystone {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_stats_polling_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backup_api_class = cinder.backup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backup_name_template = backup-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backup_use_same_host = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_internal_tenant_project_id = 8d26b79967a8421893d3c05bcbd96187 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_internal_tenant_user_id = 973e1039a0ee45d9b7d973775d651995 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cluster = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] compression_format = gzip {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] config_dir = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] config_source = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] control_exchange = openstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] debug = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] default_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] default_group_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] default_volume_type = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] enable_new_services = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_api_insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_api_servers = ['http://192.168.122.218/image'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_api_ssl_compression = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_ca_certificates_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_num_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance_request_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] graceful_shutdown_timeout = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] group_api_class = cinder.group.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] host = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_compress_on_upload = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_conversion_address_space_limit = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_conversion_cpu_limit = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_conversion_disable = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_introspection_address_space_limit = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_introspection_cpu_limit = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] init_host_max_objects_retrieval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] instance_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] iser_ip_address = 192.168.122.218 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86665) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_color = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_config_append = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_options = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_rotate_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_rotate_interval_type = days {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] log_rotation_type = none {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] max_age = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] max_logfile_count = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] max_logfile_size_mb = 200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] message_reap_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] message_ttl = 2592000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] monkey_patch = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] monkey_patch_modules = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] my_ip = 192.168.122.218 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] no_snapshot_gb_quota = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_max_limit = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_volume_ext_list = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_volume_listen_port = 8776 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_volume_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] osapi_volume_workers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] per_volume_size_limit = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] periodic_fuzzy_delay = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] periodic_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] public_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] publish_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_backup_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_backups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_groups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_snapshots = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] quota_volumes = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] rate_limit_burst = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] rate_limit_except_level = CRITICAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] rate_limit_interval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] reinit_driver_count = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] report_interval = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] reservation_clean_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] reservation_expire = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] reserved_image_namespaces = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] rpc_response_timeout = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] run_external_periodic_tasks = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_down_time = 720 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] shell_completion = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] snapshot_name_template = snapshot-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] state_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] storage_availability_zone = nova {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] syslog_log_facility = LOG_USER {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] target_helper = lioadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] target_ip_address = 192.168.122.218 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] until_refresh = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_default_quota_class = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_journal = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_json = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_stderr = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] use_syslog = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] verify_glance_signatures = enabled {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_api_class = cinder.volume.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_name_template = volume-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_service_inithost_offload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volume_usage_audit_period = month {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] zoning_mode = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.auth_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.interface = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcache_username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.service_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.218/identity {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.backend = dogpile.cache.null {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.backend_argument = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.backend_expiration_time = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.config_prefix = cache.oslo {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.debug_cache_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.enable_retry_client = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.enable_socket_keepalive = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.expiration_time = 600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.proxies = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.redis_db = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.redis_server = localhost:6379 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.retry_delay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.socket_keepalive_count = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.socket_keepalive_idle = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.socket_keepalive_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.socket_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cache.username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] coordination.backend_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.asyncio_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.asyncio_slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.backend = sqlalchemy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.connection_debug = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.connection_parameters = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.connection_recycle_time = 3600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.connection_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.db_inc_retry_interval = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.db_max_retries = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.db_max_retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.db_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.max_overflow = 50 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.max_pool_size = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.max_retries = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.pool_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.sqlite_synchronous = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.synchronous_reader = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] database.use_db_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_tracing.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.connection_string = messaging:// {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.es_doc_type = notification {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.es_scroll_size = 10000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.es_scroll_time = 2m {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.filter_error_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.hmac_keys = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.socket_timeout = 0.1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.trace_requests = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler.trace_sqlalchemy = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler_jaeger.process_tags = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] profiler_otlp.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.policy_default_rule = default {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] privsep_osbrick.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86665) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 17:52:21 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 17:52:21 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] cinder_sys_admin.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.send_service_user_token = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.tls_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] service_user.tls_min_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.tls_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] glance.tls_min_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.extra_capabilities = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.iser_ip_address = 192.168.122.218 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_host = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_login = admin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_private_key = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_share_path = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.target_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.target_ip_address = 192.168.122.218 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_reports.file_event_handler = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_reports.log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.chap_username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.extra_capabilities = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack quobyte-client[86675]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 17:52:21 devstack quobyte-client[86675]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.iser_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.iser_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.iser_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_login = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_private_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_share_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.num_shell_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.report_discard_supported = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.reserved_percentage = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.scst_target_driver = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.storage_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.target_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.target_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.target_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.target_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.use_chap_auth = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_clear = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_clear_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] QuobyteHD.volumes_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_notifications.driver = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] key_manager.fixed_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.barbican_api_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.barbican_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.barbican_endpoint_type = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.barbican_region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.number_of_retries = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.retry_delay = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.send_service_user_token = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.tls_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.tls_min_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.verify_ssl = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican.verify_ssl_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.auth_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.tls_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] barbican_service_user.tls_min_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.approle_role_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.approle_secret_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.auth_method = approle {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.auth_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.kv_mountpoint = secret {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.kv_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.kv_version = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.root_token_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.token_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.token_role = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:52:21 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-85d0d05b-b318-4cbd-b7d8-c199267896a6 None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 17:52:22 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.237s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.volume.driver [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.volume.driver [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2857971191406, 'free_capacity_gb': 1775.2857971191406, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86665) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_db.sqlalchemy.engines [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writer thread running {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.db.api [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Building query based on filter {{(pid=86665) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86665) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.keymgr.migration [None req-fa742a9a-c186-42ff-b31f-a47dcce26867 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:52:22 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:22 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:22 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.243s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Driver initialization completed successfully. Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Initiating service 3 cleanup Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Service 3 cleanup completed. Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.service [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Creating RPC server for service cinder-volume {{(pid=86665) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.service [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86665) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:52:22 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:52:22 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:52:22 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Sep 25 17:52:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:52:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4184e2ba-524a-49de-be7e-bd811f31bfd5 None None] Driver post RPC initialization completed successfully. Sep 25 17:52:31 devstack cinder-volume[86379]: DEBUG dbcounter [-] [86379] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:52:32 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:52:32 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:52:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:52:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 6 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:52:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Flow 'volume_create_manager' (f739817e-5091-48e5-b163-d0f85f526dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc611ea-b6b3-44d5-b95a-3d69849617c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc611ea-b6b3-44d5-b95a-3d69849617c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-401337554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269dc868-d3c3-4941-a6d9-204c2cdc7490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd623b0d0644e87a0e164eb04306408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:53:22Z,use_quota=True,user_id='4a9750817f5a44e4b15964209197a5f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dad512-12a2-438c-9e2a-07626b2991a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dad512-12a2-438c-9e2a-07626b2991a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f59355-8785-473a-bf24-61b903f2c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f59355-8785-473a-bf24-61b903f2c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269dc868-d3c3-4941-a6d9-204c2cdc7490', 'volume_name': 'volume-269dc868-d3c3-4941-a6d9-204c2cdc7490', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efff78e2-7ecd-44a2-aca3-342254ce8d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efff78e2-7ecd-44a2-aca3-342254ce8d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118b256d-de5e-48f2-a644-4d8f0e68ac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:21 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Volume 269dc868-d3c3-4941-a6d9-204c2cdc7490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269dc868-d3c3-4941-a6d9-204c2cdc7490', 'volume_size': 1} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-401337554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269dc868-d3c3-4941-a6d9-204c2cdc7490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd623b0d0644e87a0e164eb04306408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:53:22Z,use_quota=True,user_id='4a9750817f5a44e4b15964209197a5f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Creating volume 269dc868-d3c3-4941-a6d9-204c2cdc7490 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:53:21 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:53:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:21 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 1073741824 Sep 25 17:53:21 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:22 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 1073741824" returned: 0 in 0.812s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:22 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 Sep 25 17:53:22 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:23 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490" returned: 0 in 0.344s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118b256d-de5e-48f2-a644-4d8f0e68ac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269dc868-d3c3-4941-a6d9-204c2cdc7490', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b5127b-8019-488c-a5f2-3164c9c12350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Volume volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 (269dc868-d3c3-4941-a6d9-204c2cdc7490): created successfully Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b5127b-8019-488c-a5f2-3164c9c12350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Flow 'volume_create_manager' (f739817e-5091-48e5-b163-d0f85f526dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:53:23 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a4e1c67c-494c-4122-9f2c-fcd7a11194be tempest-TaggedAttachmentsTest-299950231 None] Created volume successfully. Sep 25 17:53:33 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:53:33 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Flow 'volume_create_manager' (d0bd7a7c-e15d-48ad-bfe4-ba3867cf3f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bbbe96-c175-4e6b-968c-edab9ee628e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bbbe96-c175-4e6b-968c-edab9ee628e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1773409789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffb3b97-5768-420c-b74b-4e86c474397a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c1ae4211b84d088e16a211ef593199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:53:45Z,use_quota=True,user_id='800a220ad1f64253bffdde7644467281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1605ae6d-1384-4893-b439-6927baba876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1605ae6d-1384-4893-b439-6927baba876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0a1a9f-2cf3-4cee-8cd6-eb6918d3a119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0a1a9f-2cf3-4cee-8cd6-eb6918d3a119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffb3b97-5768-420c-b74b-4e86c474397a', 'volume_name': 'volume-1ffb3b97-5768-420c-b74b-4e86c474397a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19154086-e61b-4935-b502-1416fa6dd5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19154086-e61b-4935-b502-1416fa6dd5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12274d43-0a7f-4194-a519-77499aa5093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:45 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Volume 1ffb3b97-5768-420c-b74b-4e86c474397a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffb3b97-5768-420c-b74b-4e86c474397a', 'volume_size': 1} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1773409789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffb3b97-5768-420c-b74b-4e86c474397a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c1ae4211b84d088e16a211ef593199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:53:45Z,use_quota=True,user_id='800a220ad1f64253bffdde7644467281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Creating volume 1ffb3b97-5768-420c-b74b-4e86c474397a {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:53:45 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:53:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:45 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a 1073741824 Sep 25 17:53:45 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:46 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a 1073741824" returned: 0 in 1.279s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:47 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a Sep 25 17:53:47 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:48 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a" returned: 0 in 1.082s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.460s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12274d43-0a7f-4194-a519-77499aa5093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffb3b97-5768-420c-b74b-4e86c474397a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38bc769-cdb6-489f-8b78-24141a65666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:53:48 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Volume volume-1ffb3b97-5768-420c-b74b-4e86c474397a (1ffb3b97-5768-420c-b74b-4e86c474397a): created successfully Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38bc769-cdb6-489f-8b78-24141a65666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:53:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Flow 'volume_create_manager' (d0bd7a7c-e15d-48ad-bfe4-ba3867cf3f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:53:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-15c4a705-25f1-47bd-bdd3-c4b03b0a55e6 tempest-VolumesAdminNegativeTest-403501968 None] Created volume successfully. Sep 25 17:53:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Acquiring lock "cinder-1ffb3b97-5768-420c-b74b-4e86c474397a-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:53:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Lock "cinder-1ffb3b97-5768-420c-b74b-4e86c474397a-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:53:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Acquiring lock "cinder-quobyte-1ffb3b97-5768-420c-b74b-4e86c474397a" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:53:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Lock "cinder-quobyte-1ffb3b97-5768-420c-b74b-4e86c474397a" acquired by "delete_volume" :: waited 0.072s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:53:50 devstack cinder-volume[86665]: INFO oslo.privsep.daemon [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp48fglkn9/privsep.sock'] Sep 25 17:53:50 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp48fglkn9/privsep.sock Sep 25 17:53:50 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 17:53:53 devstack cinder-volume[86665]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 17:53:54 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:54 devstack cinder-volume[86665]: INFO oslo.privsep.daemon [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Spawned new privsep daemon via rootwrap Sep 25 17:53:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Accepted privsep connection to /tmp/tmp48fglkn9/privsep.sock {{(pid=86665) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 17:53:54 devstack cinder-volume[86665]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 17:53:54 devstack cinder-volume[86665]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 17:53:54 devstack cinder-volume[86665]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 17:53:54 devstack cinder-volume[86665]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87932 Sep 25 17:53:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ffc803-e711-4142-a34e-4c7c6bcd18e2]: (2,) {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:53:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e4d2b6-f677-4dc9-aeb8-fb98baf3513f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:53:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:54 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a Sep 25 17:53:54 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:55 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a" returned: 0 in 1.451s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:55 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a Sep 25 17:53:55 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:55 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:53:55 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:56 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.611s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 8 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:53:56 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ffb3b97-5768-420c-b74b-4e86c474397a" returned: 0 in 0.701s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Lock "cinder-quobyte-1ffb3b97-5768-420c-b74b-4e86c474397a" released by "delete_volume" :: held 5.759s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:53:56 devstack cinder-volume[86665]: WARNING cinder.quota [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:53:56 devstack cinder-volume[86665]: WARNING cinder.quota [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:53:56 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Created reservations ['04d1596c-ba8c-4bde-a1df-9a154b948fe2', '6e95cded-5f9a-455c-b006-eb0336df0233', '68baaf3b-e32b-4f44-a217-fd84debc8756', '3fbdd64f-8df0-45a9-b1f3-10e5f4aed345'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:53:57 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:53:57 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:53:57 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:53:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Deleted volume successfully. Sep 25 17:53:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d08e9ecd-5b91-4f95-8ba2-54f5fa52badf tempest-VolumesAdminNegativeTest-403501968 None] Lock "cinder-1ffb3b97-5768-420c-b74b-4e86c474397a-delete_volume" released by "delete_volume" :: held 6.977s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Flow 'volume_create_manager' (5b8aa3e3-24a7-4cea-a02d-5d8fe7f4230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0245deb-a172-4558-8629-16ecce236a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0245deb-a172-4558-8629-16ecce236a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-983401212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6df0d8-2a83-472f-a174-40d55730298f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b899f34c914683a86e1af08540748d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:54:07Z,use_quota=True,user_id='28aa73e8f9d64465bf2e25c8e442c482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364953b4-ca67-4bf2-94cb-2f50b53f3d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364953b4-ca67-4bf2-94cb-2f50b53f3d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8222e2b-5349-4f0a-b8ea-4f369da60270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8222e2b-5349-4f0a-b8ea-4f369da60270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6df0d8-2a83-472f-a174-40d55730298f', 'volume_name': 'volume-7f6df0d8-2a83-472f-a174-40d55730298f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f85f57-5941-4390-89f3-46506f70d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f85f57-5941-4390-89f3-46506f70d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b306b7-9253-4ac5-bb2c-64978e0f9d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:54:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Volume 7f6df0d8-2a83-472f-a174-40d55730298f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6df0d8-2a83-472f-a174-40d55730298f', 'volume_size': 1} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-983401212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6df0d8-2a83-472f-a174-40d55730298f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b899f34c914683a86e1af08540748d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:54:07Z,use_quota=True,user_id='28aa73e8f9d64465bf2e25c8e442c482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Creating volume 7f6df0d8-2a83-472f-a174-40d55730298f {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:54:06 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:54:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:54:06 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f 1073741824 Sep 25 17:54:06 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:54:07 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Sep 25 17:54:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f 1073741824" returned: 0 in 0.756s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:54:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:54:07 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f Sep 25 17:54:07 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:54:08 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f" returned: 0 in 0.332s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b306b7-9253-4ac5-bb2c-64978e0f9d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6df0d8-2a83-472f-a174-40d55730298f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab58b644-c01f-4e45-9a5c-0bf6feddc15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:54:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Volume volume-7f6df0d8-2a83-472f-a174-40d55730298f (7f6df0d8-2a83-472f-a174-40d55730298f): created successfully Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab58b644-c01f-4e45-9a5c-0bf6feddc15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:54:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Flow 'volume_create_manager' (5b8aa3e3-24a7-4cea-a02d-5d8fe7f4230c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:54:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c7f46c22-40cc-4f3c-98c9-979fc1cbbf32 tempest-ServerRescueNegativeTestJSON-103712471 None] Created volume successfully. Sep 25 17:54:18 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:INSERT=4 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:54:18 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=16,cinder:DELETE=3,cinder:SELECT=8,cinder:INSERT=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:54:32 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:54:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Acquiring lock "cinder-7f6df0d8-2a83-472f-a174-40d55730298f-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:54:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "cinder-7f6df0d8-2a83-472f-a174-40d55730298f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:54:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Acquiring lock "cinder-quobyte-7f6df0d8-2a83-472f-a174-40d55730298f" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:54:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "cinder-quobyte-7f6df0d8-2a83-472f-a174-40d55730298f" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:54:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa06c8-77fe-46f4-aed8-c0a0dc557497]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:54:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:54:34 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f Sep 25 17:54:34 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:54:34 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Sep 25 17:54:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f" returned: 0 in 0.666s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:54:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:54:34 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f Sep 25 17:54:34 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:54:35 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f6df0d8-2a83-472f-a174-40d55730298f" returned: 0 in 0.518s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "cinder-quobyte-7f6df0d8-2a83-472f-a174-40d55730298f" released by "delete_volume" :: held 1.268s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Created reservations ['3a4729ff-5342-4e01-8542-9af1016d1bfb', '2e0404c2-0b91-422f-85c0-d742d355b828', '4480525a-8235-46bb-a3d9-0035bc9be906', '5d47ceb4-a210-45f5-a5ca-9e1a3ec715dc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:54:35 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:54:35 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:54:35 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:54:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Deleted volume successfully. Sep 25 17:54:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-38d470c0-962d-41c8-932b-303fdddd4fc9 tempest-ServerRescueNegativeTestJSON-103712471 None] Lock "cinder-7f6df0d8-2a83-472f-a174-40d55730298f-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:54:39 devstack cinder-volume[86665]: WARNING py.warnings [req-7de0ae6c-e534-48ad-bb3b-97f877ef529e req-492209a2-75b8-478e-9d8d-0c759b939ada tempest-TaggedAttachmentsTest-299950231 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 25 17:54:39 devstack cinder-volume[86665]: .first() Sep 25 17:54:39 devstack cinder-volume[86665]: Sep 25 17:54:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7de0ae6c-e534-48ad-bb3b-97f877ef529e req-492209a2-75b8-478e-9d8d-0c759b939ada tempest-TaggedAttachmentsTest-299950231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:54:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7de0ae6c-e534-48ad-bb3b-97f877ef529e req-492209a2-75b8-478e-9d8d-0c759b939ada tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:54:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7de0ae6c-e534-48ad-bb3b-97f877ef529e req-492209a2-75b8-478e-9d8d-0c759b939ada tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:54:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7de0ae6c-e534-48ad-bb3b-97f877ef529e req-492209a2-75b8-478e-9d8d-0c759b939ada tempest-TaggedAttachmentsTest-299950231 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-269dc868-d3c3-4941-a6d9-204c2cdc7490', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '855882b1-7546-4316-9ed9-949f83ac5097', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:54:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-7de0ae6c-e534-48ad-bb3b-97f877ef529e req-492209a2-75b8-478e-9d8d-0c759b939ada tempest-TaggedAttachmentsTest-299950231 None] attachment_update completed successfully. Sep 25 17:54:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-74a0b715-0abf-47ed-a7ea-fae5fccff22b req-961b5d21-3c7e-42d9-a440-88371193731f tempest-TaggedAttachmentsTest-299950231 None] Terminate volume connection completed successfully. Sep 25 17:54:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-74a0b715-0abf-47ed-a7ea-fae5fccff22b req-961b5d21-3c7e-42d9-a440-88371193731f tempest-TaggedAttachmentsTest-299950231 None] Deleting attachment 855882b1-7546-4316-9ed9-949f83ac5097. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:54:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:54:55 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:54:55 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:54:56 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 8 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=9,cinder:SELECT=15,cinder:INSERT=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:54:56 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Flow 'volume_create_manager' (ff6696b8-1e92-4cef-bd04-2aef226e32d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e0c096-11c9-4847-afbd-d38417a8cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e0c096-11c9-4847-afbd-d38417a8cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1103649306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f017bbe-a17e-4f75-9833-82e27a3c6d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7d4874f7a45b8aa39de0c2264ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:01Z,use_quota=True,user_id='9e84fe6e11034495a0dd295bd6e6a8f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e4c223-9e60-4bee-a061-c43d5d587845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e4c223-9e60-4bee-a061-c43d5d587845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b7c0b0-c8a7-4ec2-8820-72e81d9fcc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b7c0b0-c8a7-4ec2-8820-72e81d9fcc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f017bbe-a17e-4f75-9833-82e27a3c6d58', 'volume_name': 'volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf8e88e-aee9-4119-bf70-1d59508bae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf8e88e-aee9-4119-bf70-1d59508bae27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be76045-e94a-46dd-b079-d8a9085dfb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Volume 8f017bbe-a17e-4f75-9833-82e27a3c6d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58', 'volume_size': 1} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1103649306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f017bbe-a17e-4f75-9833-82e27a3c6d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad7d4874f7a45b8aa39de0c2264ae6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:01Z,use_quota=True,user_id='9e84fe6e11034495a0dd295bd6e6a8f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Creating volume 8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:55:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:01 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 1073741824 Sep 25 17:55:01 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:02 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 1073741824" returned: 0 in 0.638s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:02 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 Sep 25 17:55:02 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:02 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be76045-e94a-46dd-b079-d8a9085dfb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0651dcd-6066-4357-8279-2f4fa5825990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Volume volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 (8f017bbe-a17e-4f75-9833-82e27a3c6d58): created successfully Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0651dcd-6066-4357-8279-2f4fa5825990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Flow 'volume_create_manager' (ff6696b8-1e92-4cef-bd04-2aef226e32d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-7a684d7f-1f53-46f6-a609-4f44399b2dfa req-dbc0e637-b8a0-4789-9ff1-d3f1afd2f74e tempest-VolumesSnapshotsTestJSON-2096390698 None] Created volume successfully. Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Creating offline snapshot e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 of volume 8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38c54e-2b76-46f4-9884-ab901ebbdc05]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:04 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 Sep 25 17:55:04 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Acquiring lock "cinder-269dc868-d3c3-4941-a6d9-204c2cdc7490-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Lock "cinder-269dc868-d3c3-4941-a6d9-204c2cdc7490-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Acquiring lock "cinder-quobyte-269dc868-d3c3-4941-a6d9-204c2cdc7490" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Lock "cinder-quobyte-269dc868-d3c3-4941-a6d9-204c2cdc7490" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08a0883-e4e5-406a-a691-28b52fe574ba]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:05 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58" returned: 0 in 0.587s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:05 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 Sep 25 17:55:05 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:05 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 1G Sep 25 17:55:05 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:05 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490" returned: 0 in 0.458s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:05 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490 Sep 25 17:55:05 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:05 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 1G" returned: 0 in 0.527s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:05 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 Sep 25 17:55:05 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:05 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-269dc868-d3c3-4941-a6d9-204c2cdc7490" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Lock "cinder-quobyte-269dc868-d3c3-4941-a6d9-204c2cdc7490" released by "delete_volume" :: held 0.859s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Created reservations ['c205d060-700e-47b9-b50c-db4b58e27fd7', 'ca7ac7a7-8fb7-46cd-bd30-1036223cadd0', '2efb7511-b57c-4c9c-affd-0a37a864cf7d', 'b2b88d1a-da84-4eed-a404-9a641734fc95'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:05 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:55:05 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:05 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" returned: 0 in 0.371s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:05 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 is being set with open permissions: ugo+rw Sep 25 17:55:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:05 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 Sep 25 17:55:05 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:06 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" returned: 0 in 0.313s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:06 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.373s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:55:06 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Deleted volume successfully. Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-de5f3514-d020-4e50-abd7-d6d3a8035660 tempest-TaggedAttachmentsTest-299950231 None] Lock "cinder-269dc868-d3c3-4941-a6d9-204c2cdc7490-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:06 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info Sep 25 17:55:06 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:06 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:06 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info is being set with open permissions: ugo+rw Sep 25 17:55:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:06 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info Sep 25 17:55:06 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:07 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.info" returned: 0 in 0.403s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-0e06aa96-82fc-40f2-a899-ef70a577cad3 req-3bdc6700-c057-417e-8f24-81925202d66a tempest-VolumesSnapshotsTestJSON-2096390698 None] Create snapshot completed successfully Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Flow 'volume_create_manager' (abac072f-cb35-4391-805e-1ecbcb3df1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c65066-4bca-4d78-9d4c-f8ea657fceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c65066-4bca-4d78-9d4c-f8ea657fceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-52775468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3d776e-6e01-4c91-b872-5f84ddf32799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cd7ad37faa432e957bdc2f6884ff29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:07Z,use_quota=True,user_id='bdf3d69d8a1f4535ad3456035fa4b22f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a67f5a-656a-4e94-84dd-655040426061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a67f5a-656a-4e94-84dd-655040426061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aa759e-e204-41e3-a771-0560355c1d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aa759e-e204-41e3-a771-0560355c1d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3d776e-6e01-4c91-b872-5f84ddf32799', 'volume_name': 'volume-fb3d776e-6e01-4c91-b872-5f84ddf32799', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb687b30-0f76-4c0f-89fa-403a21ef99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb687b30-0f76-4c0f-89fa-403a21ef99d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3619857b-7b71-40ef-a45e-09f156d8030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Volume fb3d776e-6e01-4c91-b872-5f84ddf32799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3d776e-6e01-4c91-b872-5f84ddf32799', 'volume_size': 1} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-52775468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3d776e-6e01-4c91-b872-5f84ddf32799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cd7ad37faa432e957bdc2f6884ff29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:07Z,use_quota=True,user_id='bdf3d69d8a1f4535ad3456035fa4b22f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Creating volume fb3d776e-6e01-4c91-b872-5f84ddf32799 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:07 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:07 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 1073741824 Sep 25 17:55:07 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:07 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 1073741824" returned: 0 in 0.518s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:07 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 Sep 25 17:55:07 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "cinder-e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "cinder-quobyte-8f017bbe-a17e-4f75-9833-82e27a3c6d58" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-quobyte-8f017bbe-a17e-4f75-9833-82e27a3c6d58" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "cinder-quobyte-e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-quobyte-e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Deleting offline snapshot e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 of volume 8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] snapshot_file for this snap is: volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[634fb277-3c69-499e-86ab-45a2f6d041dd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:08 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3619857b-7b71-40ef-a45e-09f156d8030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3d776e-6e01-4c91-b872-5f84ddf32799', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8299346-4566-44f4-bac0-8f09c066503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Volume volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 (fb3d776e-6e01-4c91-b872-5f84ddf32799): created successfully Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8299346-4566-44f4-bac0-8f09c066503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Flow 'volume_create_manager' (abac072f-cb35-4391-805e-1ecbcb3df1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f4c25e43-e5b9-46bf-8ec1-39fc07506e62 tempest-DeleteServersTestJSON-1851070867 None] Created volume successfully. Sep 25 17:55:08 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 Sep 25 17:55:08 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:08 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" returned: 0 in 0.453s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25eb0aa-4241-4e25-93df-3a1b030b1da4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:08 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 Sep 25 17:55:08 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:09 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58" returned: 0 in 0.615s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:09 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 Sep 25 17:55:09 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:09 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" returned: 0 in 0.434s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:09 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1 Sep 25 17:55:09 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:10 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58.e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" returned: 0 in 0.446s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-quobyte-e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1" released by "_delete_snapshot" :: held 2.190s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-quobyte-8f017bbe-a17e-4f75-9833-82e27a3c6d58" released by "delete_snapshot" :: held 2.241s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:10 devstack cinder-volume[86665]: WARNING cinder.quota [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:55:10 devstack cinder-volume[86665]: DEBUG cinder.quota [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Created reservations ['aa29c2eb-4845-4a01-8cfa-7a8882ee86f9', '86fbe9c2-7d2a-46ef-9494-150c42c6d65c', 'afed143c-5c7f-4f10-b87d-0a5ccaf52331', '7e2263f1-d55c-4c4a-a58b-44bf20496734'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Delete snapshot completed successfully. Sep 25 17:55:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-0c1a4570-a4b3-4108-aa8f-8557a506bd1c req-eae08903-ba0c-4291-bb2f-7eee722da61c tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-e3ad6d3f-4efb-4fb5-a4e6-0ac980d299e1-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-fa0fb616-c5ec-425b-abae-06f2ee18a3dc req-a096fc23-3cc8-44be-b170-274ed160c698 tempest-DeleteServersTestJSON-1851070867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-fa0fb616-c5ec-425b-abae-06f2ee18a3dc req-a096fc23-3cc8-44be-b170-274ed160c698 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-fa0fb616-c5ec-425b-abae-06f2ee18a3dc req-a096fc23-3cc8-44be-b170-274ed160c698 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-fa0fb616-c5ec-425b-abae-06f2ee18a3dc req-a096fc23-3cc8-44be-b170-274ed160c698 tempest-DeleteServersTestJSON-1851070867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-fb3d776e-6e01-4c91-b872-5f84ddf32799', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c0b4095-cde8-4c35-a0e4-df242b215040', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:55:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-fa0fb616-c5ec-425b-abae-06f2ee18a3dc req-a096fc23-3cc8-44be-b170-274ed160c698 tempest-DeleteServersTestJSON-1851070867 None] attachment_update completed successfully. Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "cinder-8f017bbe-a17e-4f75-9833-82e27a3c6d58-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-8f017bbe-a17e-4f75-9833-82e27a3c6d58-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "cinder-quobyte-8f017bbe-a17e-4f75-9833-82e27a3c6d58" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-quobyte-8f017bbe-a17e-4f75-9833-82e27a3c6d58" acquired by "delete_volume" :: waited 0.037s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b121b-36d1-4ecf-a224-d9d36784a078]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:12 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 Sep 25 17:55:12 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:12 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58" returned: 0 in 0.482s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:12 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58 Sep 25 17:55:12 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:12 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8f017bbe-a17e-4f75-9833-82e27a3c6d58" returned: 0 in 0.284s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-quobyte-8f017bbe-a17e-4f75-9833-82e27a3c6d58" released by "delete_volume" :: held 0.889s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG cinder.quota [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Created reservations ['ba4752ee-c5bd-405e-a5bb-e4b1aef38b1f', '34abe4f3-28f2-4f6a-9fd5-d14f88586f9e', '66d0b229-32db-4947-8fe8-c8183a2d25e7', '6c08b183-d619-45cb-8311-7cb5b7544aea'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:12 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:55:12 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:13 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:13 devstack cinder-volume[86665]: DEBUG cinder.manager [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:55:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Deleted volume successfully. Sep 25 17:55:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-6e22bfed-4f5c-46ee-9573-f689b9b092b5 req-2d500164-3e3e-4246-bb38-0f8511e29c03 tempest-VolumesSnapshotsTestJSON-2096390698 None] Lock "cinder-8f017bbe-a17e-4f75-9833-82e27a3c6d58-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-2d7dd322-5c02-4ddc-b2e2-40bd5ecac366 req-25a18b2b-7f9d-4505-8841-0a4a471f10cd tempest-DeleteServersTestJSON-1851070867 None] Terminate volume connection completed successfully. Sep 25 17:55:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-2d7dd322-5c02-4ddc-b2e2-40bd5ecac366 req-25a18b2b-7f9d-4505-8841-0a4a471f10cd tempest-DeleteServersTestJSON-1851070867 None] Deleting attachment 5c0b4095-cde8-4c35-a0e4-df242b215040. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:55:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Acquiring lock "cinder-fb3d776e-6e01-4c91-b872-5f84ddf32799-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Lock "cinder-fb3d776e-6e01-4c91-b872-5f84ddf32799-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Acquiring lock "cinder-quobyte-fb3d776e-6e01-4c91-b872-5f84ddf32799" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Lock "cinder-quobyte-fb3d776e-6e01-4c91-b872-5f84ddf32799" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcb5f78-970a-468e-9c43-2158b3d927fe]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:17 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 Sep 25 17:55:17 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Flow 'volume_create_manager' (ff8ef985-29a7-47f3-bf46-60a5edfb8c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8061b3-6445-4f88-bcb2-e683829234a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:17 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799" returned: 0 in 0.598s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:17 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799 Sep 25 17:55:17 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8061b3-6445-4f88-bcb2-e683829234a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-841355915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3360369a-795d-4cd2-9afc-02ce0b8a9ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36f3ca76aaf4833b486d65d9c640b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:18Z,use_quota=True,user_id='c6cc1bf4ddf14aad849b557a11ba0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8581488a-bbb3-42f2-bc1e-2b55f3e1b51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8581488a-bbb3-42f2-bc1e-2b55f3e1b51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc900d4e-3cb4-478b-b63c-00f8842bba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc900d4e-3cb4-478b-b63c-00f8842bba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3360369a-795d-4cd2-9afc-02ce0b8a9ee8', 'volume_name': 'volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30901cc6-eec2-4f65-adb2-f48fb0b0e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30901cc6-eec2-4f65-adb2-f48fb0b0e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7992a40-a9a9-467c-8cda-d3966ac1cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:17 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Volume 3360369a-795d-4cd2-9afc-02ce0b8a9ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8', 'volume_size': 1} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-841355915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3360369a-795d-4cd2-9afc-02ce0b8a9ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36f3ca76aaf4833b486d65d9c640b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:18Z,use_quota=True,user_id='c6cc1bf4ddf14aad849b557a11ba0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Creating volume 3360369a-795d-4cd2-9afc-02ce0b8a9ee8 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:17 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:55:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:17 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 1073741824 Sep 25 17:55:17 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:18 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-fb3d776e-6e01-4c91-b872-5f84ddf32799" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Lock "cinder-quobyte-fb3d776e-6e01-4c91-b872-5f84ddf32799" released by "delete_volume" :: held 1.073s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Created reservations ['6ac24852-5284-447f-84e1-6ba37b99d8d7', 'c60fdfd4-925c-4780-9519-92ead5ac8d28', 'de0346e6-3cc6-487d-8a0b-4e29b076cd4a', 'b5864593-ac2f-4aa0-82b6-d1d409a1995d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:18 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:55:18 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:18 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 1073741824" returned: 0 in 0.709s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:18 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 Sep 25 17:55:18 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:18 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.333s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:55:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Deleted volume successfully. Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cab08f1e-da02-41f8-843d-3688e50655c2 tempest-DeleteServersTestJSON-1851070867 None] Lock "cinder-fb3d776e-6e01-4c91-b872-5f84ddf32799-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:18 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8" returned: 0 in 0.413s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7992a40-a9a9-467c-8cda-d3966ac1cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b596b7d8-8f6e-45b7-9fc3-15739fc2ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Volume volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 (3360369a-795d-4cd2-9afc-02ce0b8a9ee8): created successfully Sep 25 17:55:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b596b7d8-8f6e-45b7-9fc3-15739fc2ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Flow 'volume_create_manager' (ff8ef985-29a7-47f3-bf46-60a5edfb8c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b93f6f12-d376-4210-9697-6284d154e230 tempest-ServerActionsTestOtherA-1248889968 None] Created volume successfully. Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Flow 'volume_create_manager' (134f0f9d-b387-434d-9ffe-2794e2f096d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218f425b-c165-40ae-9bfb-4d174fc0417d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218f425b-c165-40ae-9bfb-4d174fc0417d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1503499663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651da775-0740-461d-90fa-80ebdf3ba4e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b682ecaf9de41a4970c7a527624403f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:23Z,use_quota=True,user_id='c224055e3e254f358673919211e20295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3c61fe-19b8-49ad-a8cc-4bd59be9d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3c61fe-19b8-49ad-a8cc-4bd59be9d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3954d128-a19b-4622-b21e-07274398b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3954d128-a19b-4622-b21e-07274398b43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651da775-0740-461d-90fa-80ebdf3ba4e1', 'volume_name': 'volume-651da775-0740-461d-90fa-80ebdf3ba4e1', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2affa-ac96-4e56-87ec-ff83e17fb97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2affa-ac96-4e56-87ec-ff83e17fb97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0444f964-8cf3-4b7c-be1f-d124c63b0ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Volume 651da775-0740-461d-90fa-80ebdf3ba4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651da775-0740-461d-90fa-80ebdf3ba4e1', 'volume_size': 1} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1503499663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651da775-0740-461d-90fa-80ebdf3ba4e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b682ecaf9de41a4970c7a527624403f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:23Z,use_quota=True,user_id='c224055e3e254f358673919211e20295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Creating volume 651da775-0740-461d-90fa-80ebdf3ba4e1 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:23 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:55:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:23 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 1073741824 Sep 25 17:55:23 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:24 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 1073741824" returned: 0 in 0.693s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:24 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 Sep 25 17:55:24 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:24 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0444f964-8cf3-4b7c-be1f-d124c63b0ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651da775-0740-461d-90fa-80ebdf3ba4e1', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4c725b-475b-44be-80d5-48ca9258b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Volume volume-651da775-0740-461d-90fa-80ebdf3ba4e1 (651da775-0740-461d-90fa-80ebdf3ba4e1): created successfully Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4c725b-475b-44be-80d5-48ca9258b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Flow 'volume_create_manager' (134f0f9d-b387-434d-9ffe-2794e2f096d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-ba982697-4f8c-42b7-8565-270a56f8e913 req-0155d5b8-5f7f-4456-b0d3-cde23459210d tempest-VolumesGetTestJSON-1450064675 None] Created volume successfully. Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Acquiring lock "cinder-651da775-0740-461d-90fa-80ebdf3ba4e1-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Lock "cinder-651da775-0740-461d-90fa-80ebdf3ba4e1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Acquiring lock "cinder-quobyte-651da775-0740-461d-90fa-80ebdf3ba4e1" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Lock "cinder-quobyte-651da775-0740-461d-90fa-80ebdf3ba4e1" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f8f5c-237f-422d-ab83-78754faa94c8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:26 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 Sep 25 17:55:26 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:26 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1" returned: 0 in 0.541s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:27 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1 Sep 25 17:55:27 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2124b387-0449-4ffb-ad33-0567e9cde601 tempest-GroupSnapshotsTest-1611723907 None] Group tempest-GroupSnapshotsTest-Group-1418003692: creating Sep 25 17:55:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2124b387-0449-4ffb-ad33-0567e9cde601 tempest-GroupSnapshotsTest-1611723907 None] Group tempest-GroupSnapshotsTest-Group-1418003692: created successfully Sep 25 17:55:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2124b387-0449-4ffb-ad33-0567e9cde601 tempest-GroupSnapshotsTest-1611723907 None] Create group completed successfully. Sep 25 17:55:27 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-651da775-0740-461d-90fa-80ebdf3ba4e1" returned: 0 in 0.313s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Lock "cinder-quobyte-651da775-0740-461d-90fa-80ebdf3ba4e1" released by "delete_volume" :: held 0.916s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG cinder.quota [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Created reservations ['deac17d1-00c7-4d82-8602-4b703466a53b', '9fbbd5fd-d1f6-421a-8364-a231073429e5', '433ba3f2-5c1c-44d2-bc9f-4d75ce937900', '43391737-ac15-4a5c-8777-9b5fc0055fa3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:27 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:55:27 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:27 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.320s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG cinder.manager [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:55:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Deleted volume successfully. Sep 25 17:55:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-a365d29a-9a49-4890-bf24-b7e72bb7fe80 req-6de4b0d6-228c-4a59-990d-cb83431a132b tempest-VolumesGetTestJSON-1450064675 None] Lock "cinder-651da775-0740-461d-90fa-80ebdf3ba4e1-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (988da847-9a0d-42e8-a2e5-4c753312c1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becf6315-2b75-4f8b-9e19-a1bc75fec90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becf6315-2b75-4f8b-9e19-a1bc75fec90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716823798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=106bcd6e-6ce9-4ce9-98ec-b02982cc29ba,host='devstack@QuobyteHD#QuobyteHD',id=b1591493-032a-4b21-96f2-b32c9b761548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:29Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58f9e86-62ae-4848-9a45-4523c0bcfa48),volume_type_id=f58f9e86-62ae-4848-9a45-4523c0bcfa48)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311b49f2-6ec6-4068-9fc2-5f594258ffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311b49f2-6ec6-4068-9fc2-5f594258ffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90ca3f9-b7dc-4f68-8e4a-d73c788276f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90ca3f9-b7dc-4f68-8e4a-d73c788276f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1591493-032a-4b21-96f2-b32c9b761548', 'volume_name': 'volume-b1591493-032a-4b21-96f2-b32c9b761548', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7966fc66-a871-48a7-994a-32a93131cdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7966fc66-a871-48a7-994a-32a93131cdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0b8051-c0d3-46ba-92cd-7a88ffb4a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Volume b1591493-032a-4b21-96f2-b32c9b761548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1591493-032a-4b21-96f2-b32c9b761548', 'volume_size': 1} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=106bcd6e-6ce9-4ce9-98ec-b02982cc29ba,created_at=2026-09-25T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716823798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=106bcd6e-6ce9-4ce9-98ec-b02982cc29ba,host='devstack@QuobyteHD#QuobyteHD',id=b1591493-032a-4b21-96f2-b32c9b761548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:29Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58f9e86-62ae-4848-9a45-4523c0bcfa48),volume_type_id=f58f9e86-62ae-4848-9a45-4523c0bcfa48)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Creating volume b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:29 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:29 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 1073741824 Sep 25 17:55:29 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:29 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 1073741824" returned: 0 in 0.667s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:30 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 Sep 25 17:55:30 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:30 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:55:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0b8051-c0d3-46ba-92cd-7a88ffb4a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1591493-032a-4b21-96f2-b32c9b761548', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e28b97-57de-45c8-8d78-f721e2522dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Volume volume-b1591493-032a-4b21-96f2-b32c9b761548 (b1591493-032a-4b21-96f2-b32c9b761548): created successfully Sep 25 17:55:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e28b97-57de-45c8-8d78-f721e2522dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (988da847-9a0d-42e8-a2e5-4c753312c1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fc7f5fae-c42e-479e-b744-71dd781dc497 tempest-GroupSnapshotsTest-1611723907 None] Created volume successfully. Sep 25 17:55:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] GroupSnapshot dc386880-827e-4c5f-a4d9-7b5a84b0b914: creating. Sep 25 17:55:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Group snapshot dc386880-827e-4c5f-a4d9-7b5a84b0b914: creating. {{(pid=86665) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:55:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Creating offline snapshot 9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 of volume b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:55:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a9d83-01c3-478c-858e-9520e1434880]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:34 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 Sep 25 17:55:34 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:35 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548" returned: 0 in 0.376s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:35 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 1G Sep 25 17:55:35 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:35 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 1G" returned: 0 in 0.417s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1591493-032a-4b21-96f2-b32c9b761548 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:35 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1591493-032a-4b21-96f2-b32c9b761548 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 Sep 25 17:55:35 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:35 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1591493-032a-4b21-96f2-b32c9b761548 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" returned: 0 in 0.339s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:35 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:55:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:35 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 Sep 25 17:55:35 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:36 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" returned: 0 in 0.255s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:36 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info Sep 25 17:55:36 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:36 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info" returned: 0 in 0.279s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:36 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:55:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:36 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info Sep 25 17:55:36 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:37 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.info" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c205ac98-a49f-4925-86bb-4e8a09359c3f tempest-GroupSnapshotsTest-1611723907 None] group_snapshot dc386880-827e-4c5f-a4d9-7b5a84b0b914: created successfully Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-9e7ff48a-7119-4aca-8bb4-a64e6c6382a6-1828a42b-5c75-45e9-83f0-48a59138e932" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-9e7ff48a-7119-4aca-8bb4-a64e6c6382a6-1828a42b-5c75-45e9-83f0-48a59138e932" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Creating volume 1828a42b-5c75-45e9-83f0-48a59138e932 from snapshot 9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-1828a42b-5c75-45e9-83f0-48a59138e932" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-1828a42b-5c75-45e9-83f0-48a59138e932" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] snapshot: 9e7ff48a-7119-4aca-8bb4-a64e6c6382a6, volume: 1828a42b-5c75-45e9-83f0-48a59138e932, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1485838c-c726-44b8-9373-10ac05988553]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:41 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 Sep 25 17:55:41 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:42 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" returned: 0 in 0.849s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1591493-032a-4b21-96f2-b32c9b761548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b168f90-ad79-4220-9973-1d0e26244dc2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:42 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 Sep 25 17:55:42 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:42 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548" returned: 0 in 0.592s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:55:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:42 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 Sep 25 17:55:42 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:50 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=55,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=9 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:55:51 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=62,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:55:51 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932" returned: 0 in 9.301s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:51 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:55:51 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Converted 1024.00 MB image at 110.08 MB/s Sep 25 17:55:51 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:55:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:52 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 Sep 25 17:55:52 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:52 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932" returned: 0 in 0.291s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-1828a42b-5c75-45e9-83f0-48a59138e932" released by "_copy_volume_from_snapshot" :: held 11.272s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-9e7ff48a-7119-4aca-8bb4-a64e6c6382a6-1828a42b-5c75-45e9-83f0-48a59138e932" released by "_create_volume_from_snapshot" :: held 11.393s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.429s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cc38a0d5-3e7c-4219-bf52-7203f80c9d9b tempest-GroupSnapshotsTest-1611723907 None] Create group from source-snapshot-dc386880-827e-4c5f-a4d9-7b5a84b0b914 completed successfully. Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-1828a42b-5c75-45e9-83f0-48a59138e932" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-1828a42b-5c75-45e9-83f0-48a59138e932" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[510cdd9d-3614-40a2-add5-28062c56ec2a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:54 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 Sep 25 17:55:54 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-69783f96-d0ad-4818-baa6-bb8ddf2bdc4d req-f428cc22-8a4b-43cd-9f3a-f93b0751e856 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-69783f96-d0ad-4818-baa6-bb8ddf2bdc4d req-f428cc22-8a4b-43cd-9f3a-f93b0751e856 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-69783f96-d0ad-4818-baa6-bb8ddf2bdc4d req-f428cc22-8a4b-43cd-9f3a-f93b0751e856 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-69783f96-d0ad-4818-baa6-bb8ddf2bdc4d req-f428cc22-8a4b-43cd-9f3a-f93b0751e856 tempest-ServerActionsTestOtherA-1248889968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ec355e7-127b-462d-897b-d2ebca3037e1', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:55:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-69783f96-d0ad-4818-baa6-bb8ddf2bdc4d req-f428cc22-8a4b-43cd-9f3a-f93b0751e856 tempest-ServerActionsTestOtherA-1248889968 None] attachment_update completed successfully. Sep 25 17:55:54 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932" returned: 0 in 0.663s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:54 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932 Sep 25 17:55:54 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Flow 'volume_create_manager' (42182339-ebf1-42df-86c5-d26b3e8ffc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88447400-0a21-4a0f-9fc3-1f105dc806a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88447400-0a21-4a0f-9fc3-1f105dc806a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1905216206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2858de52-8d09-437c-9a40-cc3674601d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579b192c555e4422bac6ce70b3edc9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:55Z,use_quota=True,user_id='62f506dd5ae94efc82001145f20f2cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a9f9e3-638d-41aa-9140-db54d86be3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a9f9e3-638d-41aa-9140-db54d86be3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb7d7f2-3062-426a-9ced-8e718493c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb7d7f2-3062-426a-9ced-8e718493c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2858de52-8d09-437c-9a40-cc3674601d61', 'volume_name': 'volume-2858de52-8d09-437c-9a40-cc3674601d61', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0c1076-f4b9-4b43-97a0-f3b3d64f47ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0c1076-f4b9-4b43-97a0-f3b3d64f47ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9687684-1c1b-4d84-bbb9-112be27634fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:55 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Volume 2858de52-8d09-437c-9a40-cc3674601d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2858de52-8d09-437c-9a40-cc3674601d61', 'volume_size': 1} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1905216206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2858de52-8d09-437c-9a40-cc3674601d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579b192c555e4422bac6ce70b3edc9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:55:55Z,use_quota=True,user_id='62f506dd5ae94efc82001145f20f2cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Creating volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:55:55 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:55 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 1073741824 Sep 25 17:55:55 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:55 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1828a42b-5c75-45e9-83f0-48a59138e932" returned: 0 in 0.353s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-1828a42b-5c75-45e9-83f0-48a59138e932" released by "delete_volume" :: held 1.099s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['3327fe57-c708-4309-8d47-4876dfa063ec'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:55 devstack cinder-volume[86665]: WARNING cinder.quota [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-13751253 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-13751253, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:55:55 devstack cinder-volume[86665]: WARNING cinder.quota [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-13751253 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-13751253, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['c709d50f-4748-4ca7-93d4-20956e1e175e', '68b65444-6670-44e7-bb66-0fae6401769b', 'e98e8f88-8e0e-4af7-86ab-be27125ae76d', '799632b9-2831-480b-b895-87996e878839'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:55 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:55:55 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:55 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 1073741824" returned: 0 in 0.609s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:55 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:55:55 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:55 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 Sep 25 17:55:55 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:56 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.431s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:55:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-45b16c7e-2ba7-41e4-b64b-3198dcaa2fce tempest-GroupSnapshotsTest-1611723907 None] Delete group completed successfully. Sep 25 17:55:56 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:55:56 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9687684-1c1b-4d84-bbb9-112be27634fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2858de52-8d09-437c-9a40-cc3674601d61', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d427f206-ed94-4464-9fb2-2dc4fc0c97ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:55:56 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Volume volume-2858de52-8d09-437c-9a40-cc3674601d61 (2858de52-8d09-437c-9a40-cc3674601d61): created successfully Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d427f206-ed94-4464-9fb2-2dc4fc0c97ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Flow 'volume_create_manager' (42182339-ebf1-42df-86c5-d26b3e8ffc31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:55:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-79f508bc-be39-419a-b7d5-f8b5f8f0ce4d tempest-SnapshotsActionsTest-704679093 None] Created volume successfully. Sep 25 17:55:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot dc386880-827e-4c5f-a4d9-7b5a84b0b914: deleting Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot dc386880-827e-4c5f-a4d9-7b5a84b0b914: deleting {{(pid=86665) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-b1591493-032a-4b21-96f2-b32c9b761548" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b1591493-032a-4b21-96f2-b32c9b761548" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Deleting offline snapshot 9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 of volume b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] snapshot_file for this snap is: volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b27f79-6e63-4ee4-81bd-e1f9c8fc7ed0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:57 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 Sep 25 17:55:57 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:57 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" returned: 0 in 0.467s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1591493-032a-4b21-96f2-b32c9b761548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc0a3f-7ced-4894-a32b-074085b127e3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Creating offline snapshot 6f454922-59dd-4eec-b5df-ed9f5c9ade6b of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8532ae-d5a9-4768-9f6e-fb6fcb191c6b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:55:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:57 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 Sep 25 17:55:57 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:57 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 Sep 25 17:55:57 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:58 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61" returned: 0 in 0.540s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:58 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b 1G Sep 25 17:55:58 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:58 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548" returned: 0 in 0.786s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:58 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 Sep 25 17:55:58 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:58 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" returned: 0 in 0.649s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:58 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6 Sep 25 17:55:58 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:58 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b 1G" returned: 0 in 0.802s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:58 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:55:58 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:59 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548.9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-9e7ff48a-7119-4aca-8bb4-a64e6c6382a6" released by "_delete_snapshot" :: held 2.396s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b1591493-032a-4b21-96f2-b32c9b761548" released by "delete_snapshot" :: held 2.434s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:55:59 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.417s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:59 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b is being set with open permissions: ugo+rw Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:59 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:55:59 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:55:59 devstack cinder-volume[86665]: WARNING cinder.quota [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-13751253 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-13751253, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['6f9ef041-c71f-45ff-a2c7-6aacf048ff00', '4f134201-b11c-4ee2-b329-5bd8f289241b', '5089d886-dfd5-46eb-b6a4-76e914bead14', 'e1524c16-fcdc-413c-9eba-a48df222fdec'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:55:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5d21a3d4-5230-4bdc-beea-98de83948750 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot dc386880-827e-4c5f-a4d9-7b5a84b0b914: deleted successfully Sep 25 17:55:59 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.349s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:55:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:55:59 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info Sep 25 17:55:59 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:00 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info" returned: 0 in 0.354s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:00 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info is being set with open permissions: ugo+rw Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:00 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info Sep 25 17:56:00 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-43fe48a6-f1c8-4f51-a511-83794605ec9e tempest-ServerActionsTestOtherA-1248889968 None] Terminate volume connection completed successfully. Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-43fe48a6-f1c8-4f51-a511-83794605ec9e tempest-ServerActionsTestOtherA-1248889968 None] Deleting attachment 1ec355e7-127b-462d-897b-d2ebca3037e1. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:56:00 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.info" returned: 0 in 0.443s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2470eb87-4b1f-4c1a-87c7-d2046f6c288f tempest-SnapshotsActionsTest-704679093 None] Create snapshot completed successfully Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-b1591493-032a-4b21-96f2-b32c9b761548" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b1591493-032a-4b21-96f2-b32c9b761548" acquired by "delete_volume" :: waited 0.043s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[439de604-f215-490f-bfa7-0e0a1ca04e02]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:01 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 Sep 25 17:56:01 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:01 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548" returned: 0 in 0.488s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-b9678e20-a9a0-488e-9c14-b3e9a0141977 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-b9678e20-a9a0-488e-9c14-b3e9a0141977 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:01 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548 Sep 25 17:56:01 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-b9678e20-a9a0-488e-9c14-b3e9a0141977 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-b9678e20-a9a0-488e-9c14-b3e9a0141977 tempest-ServerActionsTestOtherA-1248889968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a91c4f81-ddc0-443d-a832-e9d050d4b10c', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-fb886401-6eb5-450d-999c-4f6db4aa6f3c req-b9678e20-a9a0-488e-9c14-b3e9a0141977 tempest-ServerActionsTestOtherA-1248889968 None] attachment_update completed successfully. Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Creating offline snapshot 2f47fec3-79a5-4580-99cb-7d892c4763ff of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b5d3fc-8cad-4950-b640-0158594b6af7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:01 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b1591493-032a-4b21-96f2-b32c9b761548" returned: 0 in 0.457s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b1591493-032a-4b21-96f2-b32c9b761548" released by "delete_volume" :: held 1.065s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:02 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:02 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['bf8512fb-3e39-4367-a028-fe7f49b3cc15'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:02 devstack cinder-volume[86665]: WARNING cinder.db.api [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-13751253'] Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['495df5bf-cf12-4db5-801e-5bcd0ca66a6e', '6d87c78c-6bd2-4346-868c-81190d74c13b', 'c890e23b-74f5-46f3-80e6-8d615d1195cc', '91a192e9-d111-4321-9c47-936f7d2334ce'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:02 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:02 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:02 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.600s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:02 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff 1G Sep 25 17:56:02 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:02 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.316s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:02 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4133dae0-b217-4cfe-9d08-623a9f256150 tempest-GroupSnapshotsTest-1611723907 None] Delete group completed successfully. Sep 25 17:56:03 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff 1G" returned: 0 in 0.592s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:03 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff Sep 25 17:56:03 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:03 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff" returned: 0 in 0.823s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:03 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff is being set with open permissions: ugo+rw Sep 25 17:56:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:03 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff Sep 25 17:56:03 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:04 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-392e5115-ce8a-4944-8019-32094067e01a tempest-GroupSnapshotsTest-1611723907 None] Group tempest-GroupSnapshotsTest-Group-83708810: creating Sep 25 17:56:04 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-392e5115-ce8a-4944-8019-32094067e01a tempest-GroupSnapshotsTest-1611723907 None] Group tempest-GroupSnapshotsTest-Group-83708810: created successfully Sep 25 17:56:04 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-392e5115-ce8a-4944-8019-32094067e01a tempest-GroupSnapshotsTest-1611723907 None] Create group completed successfully. Sep 25 17:56:04 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff" returned: 0 in 0.673s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:04 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b5ce293f-2adc-4b12-8edc-03890e92cbac tempest-SnapshotsActionsTest-704679093 None] Create snapshot completed successfully Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-2f47fec3-79a5-4580-99cb-7d892c4763ff-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-2f47fec3-79a5-4580-99cb-7d892c4763ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-2f47fec3-79a5-4580-99cb-7d892c4763ff" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2f47fec3-79a5-4580-99cb-7d892c4763ff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Deleting offline snapshot 2f47fec3-79a5-4580-99cb-7d892c4763ff of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] snapshot_file for this snap is: volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b32a3c7-c4f3-4cd9-b124-3c130439b375]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:05 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff Sep 25 17:56:05 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:05 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff" returned: 0 in 0.468s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172fffc-0c8c-470c-8744-22389bd48405]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:05 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:05 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (9e418eb9-b947-492f-a624-1d18190242c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff41e574-b3ec-430a-826e-0d22610d3e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff41e574-b3ec-430a-826e-0d22610d3e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-206885346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7eab28-3c7f-4ba0-b0c4-059d2a121040,host='devstack@QuobyteHD#QuobyteHD',id=10166894-4e38-4ff0-a5d0-754542b147b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:06Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a663815-07f4-4330-b24e-418773d1921c),volume_type_id=6a663815-07f4-4330-b24e-418773d1921c)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7713bf-2380-4953-9afa-2df13d264f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7713bf-2380-4953-9afa-2df13d264f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:06 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119a0f63-d58c-4d3f-83ac-f7353f55fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119a0f63-d58c-4d3f-83ac-f7353f55fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10166894-4e38-4ff0-a5d0-754542b147b1', 'volume_name': 'volume-10166894-4e38-4ff0-a5d0-754542b147b1', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70621ee2-5c71-415f-8feb-8ccb3463c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70621ee2-5c71-415f-8feb-8ccb3463c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6971a670-ad33-455c-b131-235de61c4bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Volume 10166894-4e38-4ff0-a5d0-754542b147b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10166894-4e38-4ff0-a5d0-754542b147b1', 'volume_size': 1} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb7eab28-3c7f-4ba0-b0c4-059d2a121040,created_at=2026-09-25T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-206885346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7eab28-3c7f-4ba0-b0c4-059d2a121040,host='devstack@QuobyteHD#QuobyteHD',id=10166894-4e38-4ff0-a5d0-754542b147b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:06Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a663815-07f4-4330-b24e-418773d1921c),volume_type_id=6a663815-07f4-4330-b24e-418773d1921c)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Creating volume 10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:56:06 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:06 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 1073741824 Sep 25 17:56:06 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:06 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff Sep 25 17:56:06 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:06 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff" returned: 0 in 0.582s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:07 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff Sep 25 17:56:07 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:07 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 1073741824" returned: 0 in 0.677s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:07 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 Sep 25 17:56:07 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:07 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.2f47fec3-79a5-4580-99cb-7d892c4763ff" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2f47fec3-79a5-4580-99cb-7d892c4763ff" released by "_delete_snapshot" :: held 2.165s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:07 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" released by "delete_snapshot" :: held 2.225s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1" returned: 0 in 0.421s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6971a670-ad33-455c-b131-235de61c4bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10166894-4e38-4ff0-a5d0-754542b147b1', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11217cb-2b48-40a7-aaa8-f5f8dd369f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Volume volume-10166894-4e38-4ff0-a5d0-754542b147b1 (10166894-4e38-4ff0-a5d0-754542b147b1): created successfully Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11217cb-2b48-40a7-aaa8-f5f8dd369f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (9e418eb9-b947-492f-a624-1d18190242c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6745e17b-60e4-4cac-b315-0ba1d31a7a10 tempest-GroupSnapshotsTest-1611723907 None] Created volume successfully. Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Created reservations ['0f305401-629b-41cc-ab35-c1d3d84f3d0d', 'f4c94f86-b9a4-479d-b1b3-faf33fe7f6d9', '5fb567b3-1bf3-4693-a08c-d3d63188c3a6', 'ee71902c-d26e-4ab3-b5b5-f2d076a0d288'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Delete snapshot completed successfully. Sep 25 17:56:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ea97f36c-0e81-4cf9-80d0-feb321f8990d tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-2f47fec3-79a5-4580-99cb-7d892c4763ff-delete_snapshot" released by "delete_snapshot" :: held 2.646s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Creating offline snapshot b0a34717-8693-418f-aa6f-5261a70d49cb of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:09 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a76c8b-420d-480c-839a-9dd73ef239ff]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:09 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:09 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:10 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.822s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (af41425d-c4ca-485b-843a-c1d9594e1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:10 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb 1G Sep 25 17:56:10 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f41a35-b6fa-49bc-a05d-a82413e0e892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f41a35-b6fa-49bc-a05d-a82413e0e892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-31052270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7eab28-3c7f-4ba0-b0c4-059d2a121040,host='devstack@QuobyteHD#QuobyteHD',id=ab83652f-b42c-443e-8523-16d729734cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:10Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a663815-07f4-4330-b24e-418773d1921c),volume_type_id=6a663815-07f4-4330-b24e-418773d1921c)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840006e7-2e2e-4565-9731-878cd07ec914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840006e7-2e2e-4565-9731-878cd07ec914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f281a7c5-d3c3-4a8c-8072-ccbd2b45ce2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f281a7c5-d3c3-4a8c-8072-ccbd2b45ce2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab83652f-b42c-443e-8523-16d729734cff', 'volume_name': 'volume-ab83652f-b42c-443e-8523-16d729734cff', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd30fc1-21eb-4dd9-aa9a-652296d3cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd30fc1-21eb-4dd9-aa9a-652296d3cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695bdb6e-114e-4ee5-8a10-e229ccbca5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:10 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Volume ab83652f-b42c-443e-8523-16d729734cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab83652f-b42c-443e-8523-16d729734cff', 'volume_size': 1} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:10 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb 1G" returned: 0 in 0.655s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:10 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb Sep 25 17:56:10 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:11 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb" returned: 0 in 0.460s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:11 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb is being set with open permissions: ugo+rw Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:11 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb Sep 25 17:56:11 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:11 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb" returned: 0 in 0.381s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb7eab28-3c7f-4ba0-b0c4-059d2a121040,created_at=2026-09-25T15:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-31052270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb7eab28-3c7f-4ba0-b0c4-059d2a121040,host='devstack@QuobyteHD#QuobyteHD',id=ab83652f-b42c-443e-8523-16d729734cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:10Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a663815-07f4-4330-b24e-418773d1921c),volume_type_id=6a663815-07f4-4330-b24e-418773d1921c)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Creating volume ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:56:11 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:56:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:11 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff 1073741824 Sep 25 17:56:11 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-23522dd6-604f-436b-8347-0f516310def9 tempest-SnapshotsActionsTest-704679093 None] Create snapshot completed successfully Sep 25 17:56:12 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff 1073741824" returned: 0 in 0.914s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:12 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff Sep 25 17:56:12 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-b0a34717-8693-418f-aa6f-5261a70d49cb-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-b0a34717-8693-418f-aa6f-5261a70d49cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-b0a34717-8693-418f-aa6f-5261a70d49cb" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-b0a34717-8693-418f-aa6f-5261a70d49cb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Deleting offline snapshot b0a34717-8693-418f-aa6f-5261a70d49cb of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] snapshot_file for this snap is: volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47963a6-7c2f-4a30-835a-a7b0acfe2ffa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:13 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff" returned: 0 in 0.416s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695bdb6e-114e-4ee5-8a10-e229ccbca5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab83652f-b42c-443e-8523-16d729734cff', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ea73e9-29b8-4ac7-bbae-b4590560bc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Volume volume-ab83652f-b42c-443e-8523-16d729734cff (ab83652f-b42c-443e-8523-16d729734cff): created successfully Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ea73e9-29b8-4ac7-bbae-b4590560bc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (af41425d-c4ca-485b-843a-c1d9594e1421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-212e040f-3e4a-45a9-87b9-8329812ffd94 tempest-GroupSnapshotsTest-1611723907 None] Created volume successfully. Sep 25 17:56:13 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb Sep 25 17:56:13 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:13 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb" returned: 0 in 0.671s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5c3de4-d81b-4069-8e46-00a8387a6b3b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:14 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:14 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:14 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.771s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:14 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb Sep 25 17:56:14 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2484ffb0-c54c-48e9-89ee-7bb7eee5bb64 tempest-GroupSnapshotsTest-1611723907 None] Update group completed successfully. Sep 25 17:56:15 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb" returned: 0 in 0.689s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:15 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb Sep 25 17:56:15 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:15 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.b0a34717-8693-418f-aa6f-5261a70d49cb" returned: 0 in 0.345s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-b0a34717-8693-418f-aa6f-5261a70d49cb" released by "_delete_snapshot" :: held 2.678s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" released by "delete_snapshot" :: held 2.721s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:15 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Created reservations ['337824bf-a366-4afe-846b-48644c312d56', '9a486da4-5e43-49b9-9dba-d9254743aa21', 'e54099e3-8829-4660-b685-b1139a4a316e', 'bab782cc-86cb-4050-8c2c-95cd91ee3a53'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Delete snapshot completed successfully. Sep 25 17:56:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-527afa42-8e33-49f9-9224-832a5a2f8573 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-b0a34717-8693-418f-aa6f-5261a70d49cb-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e2c66055-88d3-4e88-88b0-31cc3ffbbce5 tempest-GroupSnapshotsTest-1611723907 None] Update group completed successfully. Sep 25 17:56:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Creating offline snapshot 5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:17 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09d1b7-3a07-40c9-a0f6-a33fae221541]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-bccbbdd9-d4f3-4c3a-be27-cafa754c9a07 tempest-GroupSnapshotsTest-1611723907 None] Update group completed successfully. Sep 25 17:56:17 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:17 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:18 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.864s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:18 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 1G Sep 25 17:56:18 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2ab2be58-8d3d-44e5-8896-4e7c301a8938 tempest-GroupSnapshotsTest-1611723907 None] Update group completed successfully. Sep 25 17:56:19 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 1G" returned: 0 in 0.849s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:19 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 Sep 25 17:56:19 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:19 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" returned: 0 in 0.529s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:19 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 is being set with open permissions: ugo+rw Sep 25 17:56:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:19 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 Sep 25 17:56:19 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:20 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" returned: 0 in 0.910s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.438s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-54b748cf-f880-47a2-8040-9e8c199e03b4 tempest-SnapshotsActionsTest-704679093 None] Create snapshot completed successfully Sep 25 17:56:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] GroupSnapshot d0fa1114-7c84-4d21-a484-cbf5f4027a1e: creating. Sep 25 17:56:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Group snapshot d0fa1114-7c84-4d21-a484-cbf5f4027a1e: creating. {{(pid=86665) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:56:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Creating offline snapshot 48c00f51-b598-48b6-a984-f33e251fa384 of volume 10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:21 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f10c23-1ac1-4f12-8b1c-15acae04e442]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:21 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 Sep 25 17:56:21 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:22 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1" returned: 0 in 0.860s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" acquired by "_delete_snapshot" :: waited 0.102s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:22 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 1G Sep 25 17:56:22 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Deleting offline snapshot 5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] snapshot_file for this snap is: volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f9491-b2e5-405d-bb3b-6c703d236d88]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:22 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 Sep 25 17:56:22 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:23 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" returned: 0 in 0.799s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:23 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f381ca-7694-4086-8762-ec994d05b4ac]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:23 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 1G" returned: 0 in 1.174s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10166894-4e38-4ff0-a5d0-754542b147b1 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:23 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10166894-4e38-4ff0-a5d0-754542b147b1 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 Sep 25 17:56:23 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:23 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:23 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:24 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10166894-4e38-4ff0-a5d0-754542b147b1 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384" returned: 0 in 0.487s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:24 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:24 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 Sep 25 17:56:24 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:24 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.660s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:24 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 Sep 25 17:56:24 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:24 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384" returned: 0 in 0.434s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:24 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info Sep 25 17:56:24 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:24 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" returned: 0 in 0.687s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:24 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6 Sep 25 17:56:24 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:24 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info" returned: 0 in 0.433s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:24 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:56:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:24 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info Sep 25 17:56:24 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:25 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" returned: 0 in 0.313s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6" released by "_delete_snapshot" :: held 2.721s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" released by "delete_snapshot" :: held 2.833s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:25 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.info" returned: 0 in 0.283s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.799s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Creating offline snapshot cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 of volume ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Created reservations ['f6518e5d-24d8-448a-8e14-ce7c00676ea4', 'a675b7ec-e228-4f07-aeed-d0d1ae3e4e0c', 'b05ebff5-712e-4025-b656-8931505270eb', 'a57494ed-ce19-4c70-a891-0dd3fc463767'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4495e6-f9b9-429a-bafa-17e4cca9e824]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Delete snapshot completed successfully. Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e1e76118-c3be-4b6f-9433-81bafd528c2f tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-5f56b2ff-5d0b-4932-a4d3-eab3b90ae1a6-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:25 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff Sep 25 17:56:25 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:25 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff" returned: 0 in 0.432s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:25 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 1G Sep 25 17:56:25 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:26 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 1G" returned: 0 in 0.456s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab83652f-b42c-443e-8523-16d729734cff -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:26 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab83652f-b42c-443e-8523-16d729734cff -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 Sep 25 17:56:26 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Flow 'volume_create_manager' (65cb499f-bdf1-44d3-bffe-178d1304d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94c76d6-c8ee-463c-a6d8-4ba5df82b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94c76d6-c8ee-463c-a6d8-4ba5df82b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1309572008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d461ba-d561-470b-96a2-c216d0f435c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9be096d995485fb86a6e8a130a20a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:26Z,use_quota=True,user_id='eb9c6da5d53045638cccc0d26a359fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b18622-ad09-482e-ad20-22f6e39b1712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b18622-ad09-482e-ad20-22f6e39b1712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1c58e0-a5f5-478b-ba67-b08bac67f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1c58e0-a5f5-478b-ba67-b08bac67f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d461ba-d561-470b-96a2-c216d0f435c6', 'volume_name': 'volume-53d461ba-d561-470b-96a2-c216d0f435c6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05c9b0a-d915-46c0-b3ca-39badb98c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:26 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05c9b0a-d915-46c0-b3ca-39badb98c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780be88b-643d-414a-ba8a-165d6299f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Volume 53d461ba-d561-470b-96a2-c216d0f435c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d461ba-d561-470b-96a2-c216d0f435c6', 'volume_size': 1} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab83652f-b42c-443e-8523-16d729734cff -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:26 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:26 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 Sep 25 17:56:26 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:26 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" returned: 0 in 0.246s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:26 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info Sep 25 17:56:26 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:27 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:27 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:27 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info Sep 25 17:56:27 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:27 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.info" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.468s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Creating offline snapshot 3189209f-37f3-4280-971c-b3e2096b9724 of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f8dd2-d8d3-4507-ab25-608e530e9db7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5a45b0d6-37f4-4f65-aa66-e809d825d069 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot d0fa1114-7c84-4d21-a484-cbf5f4027a1e: created successfully Sep 25 17:56:27 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:27 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:27 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.357s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:27 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 1G Sep 25 17:56:27 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] group_snapshot d0fa1114-7c84-4d21-a484-cbf5f4027a1e: deleting Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] group_snapshot d0fa1114-7c84-4d21-a484-cbf5f4027a1e: deleting {{(pid=86665) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-10166894-4e38-4ff0-a5d0-754542b147b1" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-10166894-4e38-4ff0-a5d0-754542b147b1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-48c00f51-b598-48b6-a984-f33e251fa384" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-48c00f51-b598-48b6-a984-f33e251fa384" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Deleting offline snapshot 48c00f51-b598-48b6-a984-f33e251fa384 of volume 10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] snapshot_file for this snap is: volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcfacb3-77c4-4645-9f52-ccc4cb587bdf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:28 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 Sep 25 17:56:28 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:28 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 1G" returned: 0 in 0.551s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:28 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 Sep 25 17:56:28 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:28 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384" returned: 0 in 0.396s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10166894-4e38-4ff0-a5d0-754542b147b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[36811687-8a8f-4ed5-95a5-fea4d3b6e496]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:28 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724" returned: 0 in 0.299s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:28 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 is being set with open permissions: ugo+rw Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:28 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 Sep 25 17:56:28 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:28 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 Sep 25 17:56:28 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:28 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724" returned: 0 in 0.242s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.566s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1309572008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d461ba-d561-470b-96a2-c216d0f435c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9be096d995485fb86a6e8a130a20a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:26Z,use_quota=True,user_id='eb9c6da5d53045638cccc0d26a359fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Creating volume 53d461ba-d561-470b-96a2-c216d0f435c6 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:56:28 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:28 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 1073741824 Sep 25 17:56:28 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:28 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f5359b2b-e915-4868-bbb1-3cce3a9e590e tempest-SnapshotsActionsTest-704679093 None] Create snapshot completed successfully Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1" returned: 0 in 0.388s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:28 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 Sep 25 17:56:28 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:29 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384" returned: 0 in 0.354s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:29 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384 Sep 25 17:56:29 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:29 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 1073741824" returned: 0 in 0.434s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:29 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 Sep 25 17:56:29 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:29 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1.48c00f51-b598-48b6-a984-f33e251fa384" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-48c00f51-b598-48b6-a984-f33e251fa384" released by "_delete_snapshot" :: held 1.500s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-10166894-4e38-4ff0-a5d0-754542b147b1" released by "delete_snapshot" :: held 1.523s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-ab83652f-b42c-443e-8523-16d729734cff" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-ab83652f-b42c-443e-8523-16d729734cff" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:29 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Deleting offline snapshot cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 of volume ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] snapshot_file for this snap is: volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6" returned: 0 in 0.283s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68f8b3e-b289-4c74-b109-5b95e84418fd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780be88b-643d-414a-ba8a-165d6299f287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d461ba-d561-470b-96a2-c216d0f435c6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff80122b-32be-4f0b-98c2-6e40e5d6456c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Volume volume-53d461ba-d561-470b-96a2-c216d0f435c6 (53d461ba-d561-470b-96a2-c216d0f435c6): created successfully Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff80122b-32be-4f0b-98c2-6e40e5d6456c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Flow 'volume_create_manager' (65cb499f-bdf1-44d3-bffe-178d1304d67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d468bb86-269a-4a9a-b1e6-2d1a932764ca tempest-ServersNegativeTestJSON-1872907090 None] Created volume successfully. Sep 25 17:56:29 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 Sep 25 17:56:29 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:30 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab83652f-b42c-443e-8523-16d729734cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a74ae0-3777-45e1-9c1a-7bff88c8c976]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-3189209f-37f3-4280-971c-b3e2096b9724-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-3189209f-37f3-4280-971c-b3e2096b9724-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Acquiring lock "cinder-quobyte-3189209f-37f3-4280-971c-b3e2096b9724" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-3189209f-37f3-4280-971c-b3e2096b9724" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Deleting offline snapshot 3189209f-37f3-4280-971c-b3e2096b9724 of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:30 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff Sep 25 17:56:30 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] snapshot_file for this snap is: volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29ea379-fc0c-419f-9fa0-779ddc44d608]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:30 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 Sep 25 17:56:30 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:30 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:30 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 Sep 25 17:56:30 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:30 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724" returned: 0 in 0.462s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[56437418-2188-4d4e-b6ba-0d98e3614689]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:30 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:30 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:31 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" returned: 0 in 0.517s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:31 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1 Sep 25 17:56:31 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:31 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.597s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:31 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 Sep 25 17:56:31 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:31 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff.cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" returned: 0 in 0.445s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-cecf4693-8b2d-4a4b-98e1-87ebf3d08ba1" released by "_delete_snapshot" :: held 1.936s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-ab83652f-b42c-443e-8523-16d729734cff" released by "delete_snapshot" :: held 1.964s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:31 devstack cinder-volume[86665]: WARNING cinder.quota [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1894073126 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1894073126, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:31 devstack cinder-volume[86665]: WARNING cinder.quota [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1894073126 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1894073126, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['304beef6-2357-4b23-a103-01671a4eac89', '3f5b6d40-617e-4a40-aa3f-af33c220e0dc', '86216ddb-b9f6-46b5-86a3-5f17b1c80a43', '32c2c546-c690-4842-99f1-3cf1cb2c1752'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:31 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['209a602f-92c1-457d-84b0-a97db393d77f', '2593bb4c-5505-4180-aeff-b55f7872fcc2', 'f55f9fc1-1359-41ca-a7fc-2d9908bee66b', '6f435af6-cd54-4205-a78f-8a7fa7a785b9'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-061dd1fd-67d3-4eff-b469-854c471db15d tempest-GroupSnapshotsTest-1611723907 None] group_snapshot d0fa1114-7c84-4d21-a484-cbf5f4027a1e: deleted successfully Sep 25 17:56:32 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724" returned: 0 in 0.636s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:32 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724 Sep 25 17:56:32 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:32 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.3189209f-37f3-4280-971c-b3e2096b9724" returned: 0 in 0.417s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-3189209f-37f3-4280-971c-b3e2096b9724" released by "_delete_snapshot" :: held 2.325s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" released by "delete_snapshot" :: held 2.356s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Created reservations ['8df38d8a-098c-4af8-bb25-b3e686be1a22', 'ae0b1daf-8e6e-4393-872a-19b798b911e2', '9be7ac7a-4d42-424d-8377-fb9285b9163e', 'df6771ec-5914-45dd-aaa6-3d7ff19ebd01'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Flow 'volume_create_manager' (855ea805-8d6b-4886-9c6e-6de99eae228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eaeb7d-5e03-4cd2-ba16-70eff3322281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Delete snapshot completed successfully. Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eaeb7d-5e03-4cd2-ba16-70eff3322281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1691008769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dd5b64-4d86-42bd-accf-ce08ee04a535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9be096d995485fb86a6e8a130a20a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:33Z,use_quota=True,user_id='eb9c6da5d53045638cccc0d26a359fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154784ea-1004-4ee6-a637-99466572666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154784ea-1004-4ee6-a637-99466572666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4ea4fb-8e78-4c90-8f01-9e664d8fb0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4ea4fb-8e78-4c90-8f01-9e664d8fb0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0dd5b64-4d86-42bd-accf-ce08ee04a535', 'volume_name': 'volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e640f34b-b90f-45cb-ac59-269765763c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e640f34b-b90f-45cb-ac59-269765763c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b72fc48-3c79-4012-884a-6ca014615a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Volume a0dd5b64-4d86-42bd-accf-ce08ee04a535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535', 'volume_size': 1} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1691008769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dd5b64-4d86-42bd-accf-ce08ee04a535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9be096d995485fb86a6e8a130a20a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:33Z,use_quota=True,user_id='eb9c6da5d53045638cccc0d26a359fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Creating volume a0dd5b64-4d86-42bd-accf-ce08ee04a535 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:56:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecfc5cc5-fd25-4be6-90ce-013bda21db89 tempest-SnapshotsActionsTest-867796942 None] Lock "cinder-3189209f-37f3-4280-971c-b3e2096b9724-delete_snapshot" released by "delete_snapshot" :: held 2.692s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:32 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 1073741824 Sep 25 17:56:32 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-10166894-4e38-4ff0-a5d0-754542b147b1" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-10166894-4e38-4ff0-a5d0-754542b147b1" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf58d1c3-e180-47d0-9e18-2f0dd2e6ca3e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:33 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 Sep 25 17:56:33 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:33 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 1073741824" returned: 0 in 0.610s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:33 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 Sep 25 17:56:33 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:33 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1" returned: 0 in 0.619s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:33 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1 Sep 25 17:56:33 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:33 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535" returned: 0 in 0.386s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b72fc48-3c79-4012-884a-6ca014615a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b5d94a-7179-4fec-88d6-776cfd82742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Volume volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 (a0dd5b64-4d86-42bd-accf-ce08ee04a535): created successfully Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b5d94a-7179-4fec-88d6-776cfd82742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Flow 'volume_create_manager' (855ea805-8d6b-4886-9c6e-6de99eae228e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "cinder-6f454922-59dd-4eec-b5df-ed9f5c9ade6b-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7e645325-fc9c-44f0-aa8d-8828166ed03b tempest-ServersNegativeTestJSON-1872907090 None] Created volume successfully. Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-6f454922-59dd-4eec-b5df-ed9f5c9ade6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "cinder-quobyte-6f454922-59dd-4eec-b5df-ed9f5c9ade6b" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-quobyte-6f454922-59dd-4eec-b5df-ed9f5c9ade6b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Deleting offline snapshot 6f454922-59dd-4eec-b5df-ed9f5c9ade6b of volume 2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] snapshot_file for this snap is: volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ecedcf-f528-4004-9cb8-848ade41dcdf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:34 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-10166894-4e38-4ff0-a5d0-754542b147b1" returned: 0 in 0.316s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-10166894-4e38-4ff0-a5d0-754542b147b1" released by "delete_volume" :: held 1.008s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-ab83652f-b42c-443e-8523-16d729734cff" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-ab83652f-b42c-443e-8523-16d729734cff" acquired by "delete_volume" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:34 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:34 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b922e9a-97ca-4cec-8733-4e8fed4b9709]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:34 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff Sep 25 17:56:34 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:34 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.381s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2858de52-8d09-437c-9a40-cc3674601d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0c408-4da3-49bc-b8d5-ba1d39677bfd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:34 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 Sep 25 17:56:34 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:34 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:34 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff Sep 25 17:56:34 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:34 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab83652f-b42c-443e-8523-16d729734cff" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:34 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61" returned: 0 in 0.422s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-ab83652f-b42c-443e-8523-16d729734cff" released by "delete_volume" :: held 0.739s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:34 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:34 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['b736c822-db28-4dad-b573-dfc891e4bf76'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:35 devstack cinder-volume[86665]: WARNING cinder.quota [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1894073126 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1894073126, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "cinder-a0dd5b64-4d86-42bd-accf-ce08ee04a535-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['090d3d46-9852-4fbb-aef4-25fd930a211d', 'df6ad1c0-6d69-427c-8dd3-8f560abc0d83', 'd7835df4-30b9-4696-8c62-75553198f0b9', 'c5d6eae2-b2be-4f8c-aba5-ac2c0a33e830'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-a0dd5b64-4d86-42bd-accf-ce08ee04a535-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "cinder-quobyte-a0dd5b64-4d86-42bd-accf-ce08ee04a535" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-quobyte-a0dd5b64-4d86-42bd-accf-ce08ee04a535" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6a4a55-c1af-48b0-af9c-357c219d4d3d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['9af0f056-e050-4264-bc35-4f7f835a8322', '096041d9-a7f2-4dd8-b623-c9d4f8525228', '899882b5-a939-4ea4-9bbb-6d22bc042442', '9e608828-379a-4150-9b94-f7b3b87a8256'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:35 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:35 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 Sep 25 17:56:35 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:35 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b Sep 25 17:56:35 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:35 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:35 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:35 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61.6f454922-59dd-4eec-b5df-ed9f5c9ade6b" returned: 0 in 0.293s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:35 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535" returned: 0 in 0.449s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-quobyte-6f454922-59dd-4eec-b5df-ed9f5c9ade6b" released by "_delete_snapshot" :: held 1.619s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" released by "delete_snapshot" :: held 1.643s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:35 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:35 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535 Sep 25 17:56:35 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.304s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cd42eadc-40f5-4cf5-9367-8d2e6a9b23cb tempest-GroupSnapshotsTest-1611723907 None] Delete group completed successfully. Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Created reservations ['5772f623-f06e-4d0f-8066-d0abd0141267', '804dd4af-a592-4afc-a6f3-eb57d4367798', 'ca409be4-d757-4318-8532-2f40b230ef18', '62822e52-95c7-4e7b-84af-bb99ebe508e8'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Delete snapshot completed successfully. Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-530af717-c155-4356-adaf-18ffa4aa0a2b tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-6f454922-59dd-4eec-b5df-ed9f5c9ade6b-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:35 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a0dd5b64-4d86-42bd-accf-ce08ee04a535" returned: 0 in 0.292s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-quobyte-a0dd5b64-4d86-42bd-accf-ce08ee04a535" released by "delete_volume" :: held 0.791s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Created reservations ['70fa9e09-5361-4a0c-95d5-dd5f5c46c4f8', '3f1939c0-d900-48e6-8ca9-06c5cc54f963', '7efc558c-9d71-424a-b644-990ca45ddd60', '87bbdfaf-2b25-494f-8936-5313c6d46a7f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63706c02-a347-481a-8ee7-034281e6c971 tempest-GroupSnapshotsTest-1611723907 None] Group tempest-GroupSnapshotsTest-Group-233182980: creating Sep 25 17:56:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63706c02-a347-481a-8ee7-034281e6c971 tempest-GroupSnapshotsTest-1611723907 None] Group tempest-GroupSnapshotsTest-Group-233182980: created successfully Sep 25 17:56:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63706c02-a347-481a-8ee7-034281e6c971 tempest-GroupSnapshotsTest-1611723907 None] Create group completed successfully. Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:36 devstack sudo[92283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:36 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "cinder-53d461ba-d561-470b-96a2-c216d0f435c6-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "cinder-2858de52-8d09-437c-9a40-cc3674601d61-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-53d461ba-d561-470b-96a2-c216d0f435c6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-2858de52-8d09-437c-9a40-cc3674601d61-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "cinder-quobyte-53d461ba-d561-470b-96a2-c216d0f435c6" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:36 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.274s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-quobyte-53d461ba-d561-470b-96a2-c216d0f435c6" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Deleted volume successfully. Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[756c46b1-65be-45c6-84e3-305b90d10bc3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[32698321-e7c0-4d1b-956e-6ef2469c10d9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f773c963-e53e-4759-bb04-59bcfe48baab tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-a0dd5b64-4d86-42bd-accf-ce08ee04a535-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:36 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 Sep 25 17:56:36 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:36 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 Sep 25 17:56:36 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:36 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6" returned: 0 in 0.395s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:36 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61" returned: 0 in 0.400s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:36 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6 Sep 25 17:56:36 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:36 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61 Sep 25 17:56:36 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:37 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53d461ba-d561-470b-96a2-c216d0f435c6" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-quobyte-53d461ba-d561-470b-96a2-c216d0f435c6" released by "delete_volume" :: held 0.739s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:37 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2858de52-8d09-437c-9a40-cc3674601d61" returned: 0 in 0.274s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-quobyte-2858de52-8d09-437c-9a40-cc3674601d61" released by "delete_volume" :: held 0.748s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Created reservations ['152a2bce-5c02-4d95-afa0-9e704e6609aa', '46a0698d-0d10-4bae-a45b-47a6e1a1e755', '2c8a7d60-a8a1-4631-89b5-43b414683806', '028a7b28-b11d-4172-8a11-a346472dbc41'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Created reservations ['03770dd5-0726-47a7-9373-630639c0a17d', '779f971a-8434-4b47-8d16-f25d6f53e131', '7a3ba7f8-5a22-4bf5-af01-529bd6027ad1', '09bb6ce7-650d-4544-9c2b-56cfa5686d25'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:37 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:37 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:37 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:37 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:37 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Deleted volume successfully. Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4b0d21c3-7f24-4571-8027-a7af81977996 tempest-SnapshotsActionsTest-704679093 None] Lock "cinder-2858de52-8d09-437c-9a40-cc3674601d61-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:37 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.530s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Deleted volume successfully. Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d9460cf5-ca02-46e5-bf2a-140cc1995c17 tempest-ServersNegativeTestJSON-1872907090 None] Lock "cinder-53d461ba-d561-470b-96a2-c216d0f435c6-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (ad18df6f-5768-4bfe-bbc7-773440e89743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781e4819-72bb-44fc-bc2d-8887223a90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781e4819-72bb-44fc-bc2d-8887223a90a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1995219403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56f729cf-04a6-4cd9-afcb-f9770a84c851,host='devstack@QuobyteHD#QuobyteHD',id=b9e5a1e1-0971-426e-97bc-a5ecab1494e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:38Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a9e15e7-b660-4e12-a6ad-45d2aea20992),volume_type_id=7a9e15e7-b660-4e12-a6ad-45d2aea20992)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb3cdf4-c478-4812-b111-bf3b14c029f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb3cdf4-c478-4812-b111-bf3b14c029f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fb4ffe-7258-4a7c-b414-49a85a5678b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fb4ffe-7258-4a7c-b414-49a85a5678b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e5a1e1-0971-426e-97bc-a5ecab1494e5', 'volume_name': 'volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e2daad-593d-40e3-8616-43c91658f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e2daad-593d-40e3-8616-43c91658f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec7a8ea-c434-49d6-87a4-4c4cc769c6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:38 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Volume b9e5a1e1-0971-426e-97bc-a5ecab1494e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5', 'volume_size': 1} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56f729cf-04a6-4cd9-afcb-f9770a84c851,created_at=2026-09-25T15:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1995219403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56f729cf-04a6-4cd9-afcb-f9770a84c851,host='devstack@QuobyteHD#QuobyteHD',id=b9e5a1e1-0971-426e-97bc-a5ecab1494e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bcb7aa193d4b4ba85cf7dbb292a7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:38Z,use_quota=True,user_id='4425f7cc849f4ecb82095a44a9b718c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a9e15e7-b660-4e12-a6ad-45d2aea20992),volume_type_id=7a9e15e7-b660-4e12-a6ad-45d2aea20992)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Creating volume b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:56:38 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:38 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 1073741824 Sep 25 17:56:38 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:38 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 1073741824" returned: 0 in 0.632s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:38 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 Sep 25 17:56:38 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:39 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" returned: 0 in 0.351s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec7a8ea-c434-49d6-87a4-4c4cc769c6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7815dfa1-f65f-42d9-9212-7d41707a4d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:39 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Volume volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 (b9e5a1e1-0971-426e-97bc-a5ecab1494e5): created successfully Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7815dfa1-f65f-42d9-9212-7d41707a4d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Flow 'volume_create_manager' (ad18df6f-5768-4bfe-bbc7-773440e89743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:39 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-908c9682-f809-473b-9d15-4505c1ad7223 tempest-GroupSnapshotsTest-1611723907 None] Created volume successfully. Sep 25 17:56:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] GroupSnapshot a7adad6e-9a44-4316-9347-d88aa49e9479: creating. Sep 25 17:56:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Group snapshot a7adad6e-9a44-4316-9347-d88aa49e9479: creating. {{(pid=86665) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:56:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Creating offline snapshot 0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 of volume b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:56:40 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41c94bc-be42-401c-8a86-f42cab896fd7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:40 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 Sep 25 17:56:40 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:41 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:41 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 1G Sep 25 17:56:41 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:41 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 1G" returned: 0 in 0.519s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:41 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 Sep 25 17:56:41 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:41 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" returned: 0 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:41 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:56:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:41 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 Sep 25 17:56:41 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:42 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" returned: 0 in 0.263s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:42 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info Sep 25 17:56:42 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:42 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info" returned: 0 in 0.278s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:42 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:56:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:42 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info Sep 25 17:56:42 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:42 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.info" returned: 0 in 0.324s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:42 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-631ebc03-0065-40d1-ba06-537b10b5c8aa tempest-GroupSnapshotsTest-1611723907 None] group_snapshot a7adad6e-9a44-4316-9347-d88aa49e9479: created successfully Sep 25 17:56:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot a7adad6e-9a44-4316-9347-d88aa49e9479: deleting Sep 25 17:56:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot a7adad6e-9a44-4316-9347-d88aa49e9479: deleting {{(pid=86665) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:56:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Deleting offline snapshot 0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 of volume b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] snapshot_file for this snap is: volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[98246554-4de7-4c14-8f30-f4b1913c3fe3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:44 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 Sep 25 17:56:44 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:44 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" returned: 0 in 0.441s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1b19f0-ad57-43a9-b4d6-e47feb0669f9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:44 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 Sep 25 17:56:44 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:45 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" returned: 0 in 0.457s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:45 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 Sep 25 17:56:45 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:45 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" returned: 0 in 0.422s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:45 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08 Sep 25 17:56:45 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:45 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5.0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" returned: 0 in 0.311s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-0dcb1f42-6cf0-453e-a447-ea7ba0a50b08" released by "_delete_snapshot" :: held 1.850s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" released by "delete_snapshot" :: held 1.900s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:45 devstack cinder-volume[86665]: WARNING cinder.quota [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1052778877 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1052778877, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:45 devstack cinder-volume[86665]: WARNING cinder.quota [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1052778877 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1052778877, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:46 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['7f3e1ff5-852b-4797-bba9-293ca15f0206', '53e6cd3b-4c35-4e85-a244-ed6293b85d67', 'dd2b194d-978b-4c0f-ac44-a2b09271ef64', '1e5c1509-61a5-4a10-9b63-ad3e20a424d1'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6f0229f2-6650-4afb-9702-f230f8445162 tempest-GroupSnapshotsTest-1611723907 None] group_snapshot a7adad6e-9a44-4316-9347-d88aa49e9479: deleted successfully Sep 25 17:56:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "cinder-quobyte-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff557d-acd9-468a-b85d-6f130ad3605d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:47 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 Sep 25 17:56:47 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-8c394a36-c086-4afd-a17a-bae03128337d req-25852c79-e1c4-4151-896f-7545a46091b8 tempest-ServerActionsTestOtherA-1248889968 None] Terminate volume connection completed successfully. Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-8c394a36-c086-4afd-a17a-bae03128337d req-25852c79-e1c4-4151-896f-7545a46091b8 tempest-ServerActionsTestOtherA-1248889968 None] Deleting attachment a91c4f81-ddc0-443d-a832-e9d050d4b10c. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:56:47 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" returned: 0 in 0.509s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:47 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5 Sep 25 17:56:47 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:47 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" returned: 0 in 0.308s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Lock "cinder-quobyte-b9e5a1e1-0971-426e-97bc-a5ecab1494e5" released by "delete_volume" :: held 0.945s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['afc2817f-cca8-4c3d-bc58-9f22cf033b38'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:47 devstack cinder-volume[86665]: WARNING cinder.quota [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1052778877 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1052778877, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:47 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Created reservations ['46559431-723f-4455-8597-a307ce7fda57', 'b20d16ce-a548-42ce-b06d-f84b9a3b4fe0', '303e4905-602b-43a7-b589-80bf55832f56', '5fba94f0-50a9-4815-ba5d-383adbd273be'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:48 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:48 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:48 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.377s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d0b86f99-16cc-4eeb-af45-603291e26cf0 tempest-GroupSnapshotsTest-1611723907 None] Delete group completed successfully. Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=169,cinder:UPDATE=173,cinder:INSERT=44,cinder:DELETE=6 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=163,cinder:SELECT=174,cinder:INSERT=39,cinder:DELETE=8 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Flow 'volume_create_manager' (0c57fafc-9ceb-40ea-8672-f2866cffba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694af37b-c2a1-4695-98b0-5d19df6f1dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694af37b-c2a1-4695-98b0-5d19df6f1dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-226315817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd7eb54-59ad-4a6b-a589-11c6db045fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb9c0c1cf5467bb0c08271e29967fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:52Z,use_quota=True,user_id='7ac4441a5d5e4cc988d87506660975f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(627b965b-780c-48e3-b84d-a09a0760a8ce),volume_type_id=627b965b-780c-48e3-b84d-a09a0760a8ce)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa038717-ea8d-4d36-aa20-db79b62be0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa038717-ea8d-4d36-aa20-db79b62be0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c1df9-9fdf-48d9-958a-67f8f903862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c1df9-9fdf-48d9-958a-67f8f903862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd7eb54-59ad-4a6b-a589-11c6db045fcd', 'volume_name': 'volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b736988e-b1fd-4b57-aa17-b4045e365756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b736988e-b1fd-4b57-aa17-b4045e365756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faea442-030f-4e02-9957-bf305f699cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:51 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Volume dfd7eb54-59ad-4a6b-a589-11c6db045fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd', 'volume_size': 1} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-226315817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd7eb54-59ad-4a6b-a589-11c6db045fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb9c0c1cf5467bb0c08271e29967fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:52Z,use_quota=True,user_id='7ac4441a5d5e4cc988d87506660975f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(627b965b-780c-48e3-b84d-a09a0760a8ce),volume_type_id=627b965b-780c-48e3-b84d-a09a0760a8ce)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Creating volume dfd7eb54-59ad-4a6b-a589-11c6db045fcd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:56:51 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:56:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:51 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd 1073741824 Sep 25 17:56:51 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:52 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd 1073741824" returned: 0 in 0.580s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:52 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd Sep 25 17:56:52 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:52 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd" returned: 0 in 0.435s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:56:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faea442-030f-4e02-9957-bf305f699cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f27810c-e804-4623-9ccd-2758b819779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:53 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Volume volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd (dfd7eb54-59ad-4a6b-a589-11c6db045fcd): created successfully Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f27810c-e804-4623-9ccd-2758b819779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Flow 'volume_create_manager' (0c57fafc-9ceb-40ea-8672-f2866cffba1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-798e204e-ec25-4a63-bd05-132d2d2ee5bd tempest-VolumeTypesAccessTest-580625164 None] Created volume successfully. Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Acquiring lock "cinder-dfd7eb54-59ad-4a6b-a589-11c6db045fcd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Lock "cinder-dfd7eb54-59ad-4a6b-a589-11c6db045fcd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Acquiring lock "cinder-quobyte-dfd7eb54-59ad-4a6b-a589-11c6db045fcd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Lock "cinder-quobyte-dfd7eb54-59ad-4a6b-a589-11c6db045fcd" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff580b-c588-460a-8590-b40802becdf9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:56:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:54 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd Sep 25 17:56:54 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:54 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd" returned: 0 in 0.527s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:54 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd Sep 25 17:56:54 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:54 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dfd7eb54-59ad-4a6b-a589-11c6db045fcd" returned: 0 in 0.296s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Lock "cinder-quobyte-dfd7eb54-59ad-4a6b-a589-11c6db045fcd" released by "delete_volume" :: held 0.881s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:54 devstack cinder-volume[86665]: WARNING cinder.quota [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1994735530 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1994735530, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:54 devstack cinder-volume[86665]: WARNING cinder.quota [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1994735530 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1994735530, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Created reservations ['f45037ec-1277-4dd8-adbf-6196b17a8e76', '7334d6d2-a0a1-4c61-815a-02813cbf1487', '5aa58851-3fd6-4988-b63c-5c6b9d186da5', 'c2ab60a3-6dd4-4853-b918-24106ecf598c'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:55 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:55 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:55 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Deleted volume successfully. Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cbf3497-946b-43cc-8ee5-305d0253fe0c tempest-VolumeTypesAccessTest-580625164 None] Lock "cinder-dfd7eb54-59ad-4a6b-a589-11c6db045fcd-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:56:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:56:55 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:56:55 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:56:56 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Sep 25 17:56:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.436s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:56:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:56:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:56:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 8 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:56:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Flow 'volume_create_manager' (fc9d4dd2-5dc4-4680-8471-0cd5e9b22175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65676f7f-3638-4721-b777-fd2b8033bb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65676f7f-3638-4721-b777-fd2b8033bb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-267893956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc91da0-520d-4463-bc9a-f0eb3af3fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36f3ca76aaf4833b486d65d9c640b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:58Z,use_quota=True,user_id='c6cc1bf4ddf14aad849b557a11ba0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d91a095-8296-492d-aaf6-5e7d89feb7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d91a095-8296-492d-aaf6-5e7d89feb7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136837e2-0b78-4fc6-8dde-b34a8fb067e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:58 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:56:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f69ea8c4-c82e-46b6-997e-e44040a3cf27 tempest-GroupSnapshotsV319Test-58815861 None] Group tempest-GroupSnapshotsV319Test-Group-1770538021: creating Sep 25 17:56:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f69ea8c4-c82e-46b6-997e-e44040a3cf27 tempest-GroupSnapshotsV319Test-58815861 None] Group tempest-GroupSnapshotsV319Test-Group-1770538021: created successfully Sep 25 17:56:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f69ea8c4-c82e-46b6-997e-e44040a3cf27 tempest-GroupSnapshotsV319Test-58815861 None] Create group completed successfully. Sep 25 17:56:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136837e2-0b78-4fc6-8dde-b34a8fb067e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adc91da0-520d-4463-bc9a-f0eb3af3fad5', 'volume_name': 'volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a5031c-3721-4cad-9c2a-32454db754de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a5031c-3721-4cad-9c2a-32454db754de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:56:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785ba2de-cd51-4a5b-9332-38294f4f5122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:56:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Volume adc91da0-520d-4463-bc9a-f0eb3af3fad5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:56:59 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Trying to clone adc91da0-520d-4463-bc9a-f0eb3af3fad5 from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:57:00 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c44864e-cfe7-4963-b698-53e208dd1f45]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:00 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD Sep 25 17:57:00 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:00 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 is fetched for user c6cc1bf4ddf14aad849b557a11ba0d93. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Flow 'volume_create_manager' (9c25dc8a-9e4e-42cd-ba36-5885aada3b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65f44d8-c8b6-4cdd-8787-7b9be86829b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65f44d8-c8b6-4cdd-8787-7b9be86829b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1302216362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6ea4481-88df-4a70-938a-a36d717717a1,host='devstack@QuobyteHD#QuobyteHD',id=f5d79974-b744-444d-b8f9-83b4598032ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb610ab43fa46bea47239ad2df212a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:57:01Z,use_quota=True,user_id='f5c77d66129543e9859f0065042b4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b000aec8-752c-4a22-a576-54b37d7ccc82),volume_type_id=b000aec8-752c-4a22-a576-54b37d7ccc82)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d7eac-28ab-4c8d-8848-3c17cc2995fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d7eac-28ab-4c8d-8848-3c17cc2995fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1cc0bd-f91b-40dc-befd-519b1543f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1cc0bd-f91b-40dc-befd-519b1543f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d79974-b744-444d-b8f9-83b4598032ef', 'volume_name': 'volume-f5d79974-b744-444d-b8f9-83b4598032ef', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c94ee99-1e0d-48f2-9eb8-c666eb117b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c94ee99-1e0d-48f2-9eb8-c666eb117b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6f726a-29e3-418a-a7b3-7fdc14edc2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Volume f5d79974-b744-444d-b8f9-83b4598032ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d79974-b744-444d-b8f9-83b4598032ef', 'volume_size': 1} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6ea4481-88df-4a70-938a-a36d717717a1,created_at=2026-09-25T15:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1302216362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6ea4481-88df-4a70-938a-a36d717717a1,host='devstack@QuobyteHD#QuobyteHD',id=f5d79974-b744-444d-b8f9-83b4598032ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb610ab43fa46bea47239ad2df212a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:57:01Z,use_quota=True,user_id='f5c77d66129543e9859f0065042b4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b000aec8-752c-4a22-a576-54b37d7ccc82),volume_type_id=b000aec8-752c-4a22-a576-54b37d7ccc82)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Creating volume f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:57:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:01 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef 1073741824 Sep 25 17:57:01 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f67a9-49af-4361-9b3b-74e6e43da81f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:01 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD Sep 25 17:57:01 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:01 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:01 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef 1073741824" returned: 0 in 0.544s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:01 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef Sep 25 17:57:01 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:01 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef" returned: 0 in 0.327s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-267893956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc91da0-520d-4463-bc9a-f0eb3af3fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36f3ca76aaf4833b486d65d9c640b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:56:58Z,use_quota=True,user_id='c6cc1bf4ddf14aad849b557a11ba0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Creating volume adc91da0-520d-4463-bc9a-f0eb3af3fad5 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:57:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:57:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6f726a-29e3-418a-a7b3-7fdc14edc2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d79974-b744-444d-b8f9-83b4598032ef', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceeb3d0-39ec-4ed3-9fb1-2963fd76ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:02 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 1073741824 Sep 25 17:57:02 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Volume volume-f5d79974-b744-444d-b8f9-83b4598032ef (f5d79974-b744-444d-b8f9-83b4598032ef): created successfully Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceeb3d0-39ec-4ed3-9fb1-2963fd76ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Flow 'volume_create_manager' (9c25dc8a-9e4e-42cd-ba36-5885aada3b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-723f8dd6-b9cd-4403-a5df-c61c4e731996 tempest-GroupSnapshotsV319Test-58815861 None] Created volume successfully. Sep 25 17:57:02 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 1073741824" returned: 0 in 0.578s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:02 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 Sep 25 17:57:02 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:02 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Attempting download of cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume adc91da0-520d-4463-bc9a-f0eb3af3fad5. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[064b271d-ea07-4a2a-bcec-ae663c66f748]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:03 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf Sep 25 17:57:03 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:03 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:03 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] GroupSnapshot 58c50ba1-2190-4349-84df-157ab258c380: creating. Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Group snapshot 58c50ba1-2190-4349-84df-157ab258c380: creating. {{(pid=86665) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Creating offline snapshot 453a6da5-79be-4151-b44f-d80590d02904 of volume f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:57:03 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf Sep 25 17:57:03 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c4290f-cf58-4d12-9dfb-5ea96187516f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:03 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef Sep 25 17:57:03 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:03 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf" returned: 1 in 0.414s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_dg7blqxf' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dde8f5-e67f-4d41-8a53-008a4dc8db35]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:03 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD Sep 25 17:57:03 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:04 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef" returned: 0 in 0.506s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:04 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 1G Sep 25 17:57:04 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:04 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 was qcow2, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:04 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 Sep 25 17:57:04 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:04 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 1G" returned: 0 in 0.501s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d79974-b744-444d-b8f9-83b4598032ef -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:04 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d79974-b744-444d-b8f9-83b4598032ef -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 Sep 25 17:57:04 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:04 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d79974-b744-444d-b8f9-83b4598032ef -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904" returned: 0 in 0.409s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:04 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:57:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:05 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 Sep 25 17:57:05 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:05 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904" returned: 0 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:05 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info Sep 25 17:57:05 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:05 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:05 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:57:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:05 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info Sep 25 17:57:05 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:06 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.info" returned: 0 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:06 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-eae68188-19b3-42ec-a52a-ef48fca67170 tempest-GroupSnapshotsV319Test-58815861 None] group_snapshot 58c50ba1-2190-4349-84df-157ab258c380: created successfully Sep 25 17:57:06 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5" returned: 0 in 2.712s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:06 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_uc32wblbdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:57:06 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Converted 112.00 MB image at 41.28 MB/s Sep 25 17:57:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:06 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 1G Sep 25 17:57:06 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:07 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 1G" returned: 0 in 0.521s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Downloaded image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume adc91da0-520d-4463-bc9a-f0eb3af3fad5 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 for user c6cc1bf4ddf14aad849b557a11ba0d93 is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Marking volume adc91da0-520d-4463-bc9a-f0eb3af3fad5 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:57:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] group_snapshot 58c50ba1-2190-4349-84df-157ab258c380: deleting Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Copying metadata from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 to adc91da0-520d-4463-bc9a-f0eb3af3fad5. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Creating volume glance metadata for volume adc91da0-520d-4463-bc9a-f0eb3af3fad5 backed by image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] group_snapshot 58c50ba1-2190-4349-84df-157ab258c380: deleting {{(pid=86665) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "cinder-quobyte-f5d79974-b744-444d-b8f9-83b4598032ef" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Lock "cinder-quobyte-f5d79974-b744-444d-b8f9-83b4598032ef" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "cinder-quobyte-453a6da5-79be-4151-b44f-d80590d02904" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Lock "cinder-quobyte-453a6da5-79be-4151-b44f-d80590d02904" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Deleting offline snapshot 453a6da5-79be-4151-b44f-d80590d02904 of volume f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] snapshot_file for this snap is: volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fa6c92-a504-468a-8c83-2eba640487e5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785ba2de-cd51-4a5b-9332-38294f4f5122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee09eb5-0ffb-43c3-b63a-e0bd74e2d988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Volume volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 (adc91da0-520d-4463-bc9a-f0eb3af3fad5): created successfully Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee09eb5-0ffb-43c3-b63a-e0bd74e2d988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Flow 'volume_create_manager' (fc9d4dd2-5dc4-4680-8471-0cd5e9b22175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:07 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 Sep 25 17:57:07 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-52d266af-3a39-4cde-b43b-936394f4752c tempest-ServerActionsTestOtherA-1248889968 None] Created volume successfully. Sep 25 17:57:08 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904" returned: 0 in 0.524s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d79974-b744-444d-b8f9-83b4598032ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:57:08 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[73692dc3-4707-4e7a-8a90-cde45a40b2c1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:08 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef Sep 25 17:57:08 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:08 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef" returned: 0 in 0.447s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:08 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 Sep 25 17:57:08 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:09 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904" returned: 0 in 0.439s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:09 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904 Sep 25 17:57:09 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:09 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef.453a6da5-79be-4151-b44f-d80590d02904" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Lock "cinder-quobyte-453a6da5-79be-4151-b44f-d80590d02904" released by "_delete_snapshot" :: held 1.884s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Lock "cinder-quobyte-f5d79974-b744-444d-b8f9-83b4598032ef" released by "delete_snapshot" :: held 1.928s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:09 devstack cinder-volume[86665]: WARNING cinder.quota [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1922397519 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1922397519, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:57:09 devstack cinder-volume[86665]: WARNING cinder.quota [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1922397519 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1922397519, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:57:09 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] Created reservations ['7cd1fd1a-73c5-444f-88b7-2029b49e4c52', 'c25c918e-4d4a-4cf8-a7aa-77a78c234bf9', 'ad655f0a-df99-4df8-94d8-953a81d7ae43', 'b9afc46e-0ba1-4f9c-b47e-df26e4e78956'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cd708506-f7ea-46e2-a4d0-b4be3f1814a0 tempest-GroupSnapshotsV319Test-58815861 None] group_snapshot 58c50ba1-2190-4349-84df-157ab258c380: deleted successfully Sep 25 17:57:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "cinder-quobyte-f5d79974-b744-444d-b8f9-83b4598032ef" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Lock "cinder-quobyte-f5d79974-b744-444d-b8f9-83b4598032ef" acquired by "delete_volume" :: waited 0.045s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb101b-d228-4996-bb34-8b6325e70027]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:11 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef Sep 25 17:57:11 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:11 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef" returned: 0 in 0.807s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:11 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef Sep 25 17:57:11 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:12 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5d79974-b744-444d-b8f9-83b4598032ef" returned: 0 in 0.488s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Lock "cinder-quobyte-f5d79974-b744-444d-b8f9-83b4598032ef" released by "delete_volume" :: held 1.490s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Created reservations ['e82f9e7d-d4e4-40b3-b9aa-e2fed4b18854'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:12 devstack cinder-volume[86665]: WARNING cinder.quota [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1922397519 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1922397519, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Created reservations ['02b1b8e5-7284-4259-904f-08264a864429', '882e1de9-e76a-410a-b685-7f464231d695', '4731af32-105a-44b1-8a36-e1e22741e89c', 'ec3e442e-b65c-4490-96ed-1a6eedfd8d39'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:12 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:57:12 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:12 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.463s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:57:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-06caafb4-d402-43b6-aeb4-6ba1fc68e4a7 tempest-GroupSnapshotsV319Test-58815861 None] Delete group completed successfully. Sep 25 17:57:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-d89fcd07-ddbf-47c7-97d7-fb6102d63e32 req-ba5c7d21-d43f-40a4-b78f-6689843d1f15 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-d89fcd07-ddbf-47c7-97d7-fb6102d63e32 req-ba5c7d21-d43f-40a4-b78f-6689843d1f15 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-d89fcd07-ddbf-47c7-97d7-fb6102d63e32 req-ba5c7d21-d43f-40a4-b78f-6689843d1f15 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-d89fcd07-ddbf-47c7-97d7-fb6102d63e32 req-ba5c7d21-d43f-40a4-b78f-6689843d1f15 tempest-ServerActionsTestOtherA-1248889968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5fe4627-1c0e-445e-b03b-e229258885ae', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:57:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-d89fcd07-ddbf-47c7-97d7-fb6102d63e32 req-ba5c7d21-d43f-40a4-b78f-6689843d1f15 tempest-ServerActionsTestOtherA-1248889968 None] attachment_update completed successfully. Sep 25 17:57:23 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=48,cinder:UPDATE=40,cinder:INSERT=20 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:57:23 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=4,cinder:SELECT=46 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:57:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1527f91f-cbd0-46a6-9eb2-d1f784ab29b8 tempest-GroupsV314Test-573557604 None] Group tempest-GroupsV314Test-Group-1219287828: creating Sep 25 17:57:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1527f91f-cbd0-46a6-9eb2-d1f784ab29b8 tempest-GroupsV314Test-573557604 None] Group tempest-GroupsV314Test-Group-1219287828: created successfully Sep 25 17:57:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1527f91f-cbd0-46a6-9eb2-d1f784ab29b8 tempest-GroupsV314Test-573557604 None] Create group completed successfully. Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Flow 'volume_create_manager' (5e4b4a0a-d4e4-485f-a2ce-abd4a1db6689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b934bf4-ae63-42a4-92f6-d3b54f2c7dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b934bf4-ae63-42a4-92f6-d3b54f2c7dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591024115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76bdf9c8-09cd-4e3d-a1af-28845bb1ba1d,host='devstack@QuobyteHD#QuobyteHD',id=e1198e77-223f-4846-ba95-2151bece0546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5ed72cec764e319074a311b7b06d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:57:29Z,use_quota=True,user_id='160bb9d52bbc4c19b151002efc8d93e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f01160cf-520f-471f-a1dc-2d9023870a99),volume_type_id=f01160cf-520f-471f-a1dc-2d9023870a99)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d05831-52de-4cf8-ae71-b229f5efc1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d05831-52de-4cf8-ae71-b229f5efc1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ee44d8-4119-4abe-ac3c-01c64df96b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ee44d8-4119-4abe-ac3c-01c64df96b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1198e77-223f-4846-ba95-2151bece0546', 'volume_name': 'volume-e1198e77-223f-4846-ba95-2151bece0546', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a8c010-cfac-449b-ac1f-e806cab61700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a8c010-cfac-449b-ac1f-e806cab61700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc679628-c204-42b4-b316-962670647c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Volume e1198e77-223f-4846-ba95-2151bece0546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1198e77-223f-4846-ba95-2151bece0546', 'volume_size': 1} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76bdf9c8-09cd-4e3d-a1af-28845bb1ba1d,created_at=2026-09-25T15:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591024115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76bdf9c8-09cd-4e3d-a1af-28845bb1ba1d,host='devstack@QuobyteHD#QuobyteHD',id=e1198e77-223f-4846-ba95-2151bece0546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5ed72cec764e319074a311b7b06d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:57:29Z,use_quota=True,user_id='160bb9d52bbc4c19b151002efc8d93e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f01160cf-520f-471f-a1dc-2d9023870a99),volume_type_id=f01160cf-520f-471f-a1dc-2d9023870a99)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Creating volume e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:57:29 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:29 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 1073741824 Sep 25 17:57:29 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:29 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 1073741824" returned: 0 in 0.741s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:30 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 Sep 25 17:57:30 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:30 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc679628-c204-42b4-b316-962670647c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1198e77-223f-4846-ba95-2151bece0546', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e99c37-350f-42f9-b00f-d554ab7570ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Volume volume-e1198e77-223f-4846-ba95-2151bece0546 (e1198e77-223f-4846-ba95-2151bece0546): created successfully Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e99c37-350f-42f9-b00f-d554ab7570ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Flow 'volume_create_manager' (5e4b4a0a-d4e4-485f-a2ce-abd4a1db6689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d48b4a09-0315-4da8-b763-f1ed8a6d6c1b tempest-GroupsV314Test-573557604 None] Created volume successfully. Sep 25 17:57:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Cloning volume e1198e77-223f-4846-ba95-2151bece0546 to volume a29e1025-7551-4191-9609-580e55d85b72 Sep 25 17:57:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Creating offline snapshot c412aace-d758-409a-83a2-d0a257da2909 of volume e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:57:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79ed58-302f-4a02-85f0-407a847f7f08]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:33 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 Sep 25 17:57:33 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:33 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546" returned: 0 in 0.800s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:33 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 1G Sep 25 17:57:33 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:34 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 1G" returned: 0 in 0.548s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1198e77-223f-4846-ba95-2151bece0546 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:34 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1198e77-223f-4846-ba95-2151bece0546 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 Sep 25 17:57:34 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:35 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1198e77-223f-4846-ba95-2151bece0546 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909" returned: 0 in 0.991s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:35 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:57:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:35 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 Sep 25 17:57:35 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:36 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909" returned: 0 in 0.827s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:36 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info Sep 25 17:57:36 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:36 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info" returned: 0 in 0.822s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:36 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:57:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:37 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info Sep 25 17:57:37 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:37 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.info" returned: 0 in 0.591s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Acquiring lock "cinder-quobyte-a29e1025-7551-4191-9609-580e55d85b72" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-a29e1025-7551-4191-9609-580e55d85b72" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] snapshot: c412aace-d758-409a-83a2-d0a257da2909, volume: a29e1025-7551-4191-9609-580e55d85b72, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[49999137-c3b9-4c77-bb96-9184b3acf330]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:38 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 Sep 25 17:57:38 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:38 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909" returned: 0 in 0.892s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1198e77-223f-4846-ba95-2151bece0546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:57:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fc08d5-f7d2-4038-b9d2-c8ae85b0a6e2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:38 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 Sep 25 17:57:38 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:39 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546" returned: 0 in 0.844s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:57:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:57:39 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:57:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:39 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 Sep 25 17:57:39 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Flow 'volume_create_manager' (e919eb3e-2192-4f8d-819d-a190b96bc56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41747365-4071-49bc-93c5-c8bbce4ac635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41747365-4071-49bc-93c5-c8bbce4ac635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-207587912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114d78be-7255-4310-980e-316bd83b1db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991d6b9053274f65b68b0c0636dcc705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:57:42Z,use_quota=True,user_id='d46beceb8b704ff08b71d3eff6fef2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a79a42e-d69d-45ff-9b1c-a7de14c3e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a79a42e-d69d-45ff-9b1c-a7de14c3e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35245c0c-ebac-4838-956b-ef7baab2de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35245c0c-ebac-4838-956b-ef7baab2de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114d78be-7255-4310-980e-316bd83b1db5', 'volume_name': 'volume-114d78be-7255-4310-980e-316bd83b1db5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01355bfe-7df7-4121-b631-611b66cd3fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01355bfe-7df7-4121-b631-611b66cd3fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aeb1ce-70a6-4f37-83f5-6fd39948c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:42 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Volume 114d78be-7255-4310-980e-316bd83b1db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114d78be-7255-4310-980e-316bd83b1db5', 'volume_size': 1} Sep 25 17:57:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-2f95fd0f-e250-4b3e-9373-3bb02e22d752 tempest-ServerActionsTestOtherA-1248889968 None] Terminate volume connection completed successfully. Sep 25 17:57:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-2f95fd0f-e250-4b3e-9373-3bb02e22d752 tempest-ServerActionsTestOtherA-1248889968 None] Deleting attachment b5fe4627-1c0e-445e-b03b-e229258885ae. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:57:50 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72" returned: 0 in 10.797s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546, size 1024.00 MB, duration 10.80 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:57:50 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Converted 1024.00 MB image at 94.83 MB/s Sep 25 17:57:50 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:50 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 Sep 25 17:57:50 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-5ba9f7d2-af02-4f50-a2b9-fedef7c186a3 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:50 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-a29e1025-7551-4191-9609-580e55d85b72" released by "_copy_volume_from_snapshot" :: held 12.988s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Acquiring lock "cinder-quobyte-c412aace-d758-409a-83a2-d0a257da2909" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-c412aace-d758-409a-83a2-d0a257da2909" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Deleting offline snapshot c412aace-d758-409a-83a2-d0a257da2909 of volume e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] snapshot_file for this snap is: volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[57837160-21ec-466f-b457-24ba458a6de2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:50 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 Sep 25 17:57:50 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:51 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909" returned: 0 in 0.396s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1198e77-223f-4846-ba95-2151bece0546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:57:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[242ddf39-c0d6-4fb0-826a-0aff674686f9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:51 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 Sep 25 17:57:51 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:51 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546" returned: 0 in 0.570s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:51 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 Sep 25 17:57:51 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:52 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:52 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909 Sep 25 17:57:52 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:52 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546.c412aace-d758-409a-83a2-d0a257da2909" returned: 0 in 0.292s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-c412aace-d758-409a-83a2-d0a257da2909" released by "_delete_snapshot" :: held 1.791s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.795s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.093s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-207587912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114d78be-7255-4310-980e-316bd83b1db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991d6b9053274f65b68b0c0636dcc705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:57:42Z,use_quota=True,user_id='d46beceb8b704ff08b71d3eff6fef2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Creating volume 114d78be-7255-4310-980e-316bd83b1db5 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:57:52 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:57:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:52 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 1073741824 Sep 25 17:57:52 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-bc993cb5-c82e-4feb-904c-56509581e8a2 tempest-GroupsV314Test-573557604 None] Create group from source-group-76bdf9c8-09cd-4e3d-a1af-28845bb1ba1d completed successfully. Sep 25 17:57:53 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 1073741824" returned: 0 in 0.567s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:53 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 Sep 25 17:57:53 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:53 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5" returned: 0 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-5ba9f7d2-af02-4f50-a2b9-fedef7c186a3 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.961s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aeb1ce-70a6-4f37-83f5-6fd39948c696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114d78be-7255-4310-980e-316bd83b1db5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376c73f1-7fae-4d31-bdc3-6b6ff96d83a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-5ba9f7d2-af02-4f50-a2b9-fedef7c186a3 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:53 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Volume volume-114d78be-7255-4310-980e-316bd83b1db5 (114d78be-7255-4310-980e-316bd83b1db5): created successfully Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376c73f1-7fae-4d31-bdc3-6b6ff96d83a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Flow 'volume_create_manager' (e919eb3e-2192-4f8d-819d-a190b96bc56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:57:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-24423a28-0e8b-4aea-a5ee-0202ddc73ef2 tempest-AttachVolumeShelveTestJSON-1506652302 None] Created volume successfully. Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-5ba9f7d2-af02-4f50-a2b9-fedef7c186a3 tempest-ServerActionsTestOtherA-1248889968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '520d478b-6507-4574-b883-c8b936aa8ada', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:57:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-f20571ad-e5a9-4fa0-8f85-99c077eb320b req-5ba9f7d2-af02-4f50-a2b9-fedef7c186a3 tempest-ServerActionsTestOtherA-1248889968 None] attachment_update completed successfully. Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Acquiring lock "cinder-quobyte-a29e1025-7551-4191-9609-580e55d85b72" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-a29e1025-7551-4191-9609-580e55d85b72" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fdd79f-4982-4c49-9d7d-dc4b95d9dd72]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:54 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 Sep 25 17:57:54 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:54 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72" returned: 0 in 0.518s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:54 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72 Sep 25 17:57:54 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:55 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a29e1025-7551-4191-9609-580e55d85b72" returned: 0 in 0.634s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-a29e1025-7551-4191-9609-580e55d85b72" released by "delete_volume" :: held 1.257s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Created reservations ['795a12d7-5b8f-4668-a75a-403e46f63c5d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:55 devstack cinder-volume[86665]: WARNING cinder.quota [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1521213275 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1521213275, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:57:55 devstack cinder-volume[86665]: WARNING cinder.quota [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1521213275 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1521213275, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Created reservations ['3768e434-1c7c-4381-8a50-0c5d8bc3abf5', 'ca4bacb3-840c-42d8-adb6-ff5740d64ce5', 'bbd0927a-6e91-45ce-9003-64062bc827af', '4a9e82df-453d-4ca8-bd8b-0982ba817359'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:55 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:57:55 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:55 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:55 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.446s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:55 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:55 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:57:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-05c0cb14-7177-43e4-9058-0eb0c4ab29fa tempest-GroupsV314Test-573557604 None] Delete group completed successfully. Sep 25 17:57:56 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.569s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:57:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:57:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:57:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:57:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Acquiring lock "cinder-quobyte-e1198e77-223f-4846-ba95-2151bece0546" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-e1198e77-223f-4846-ba95-2151bece0546" acquired by "delete_volume" :: waited 0.071s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d88f396-a5c8-4e8d-9ae9-b73b85757eb0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:57 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 Sep 25 17:57:57 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:57 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546" returned: 0 in 0.506s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:57 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546 Sep 25 17:57:57 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:57 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1198e77-223f-4846-ba95-2151bece0546" returned: 0 in 0.365s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Lock "cinder-quobyte-e1198e77-223f-4846-ba95-2151bece0546" released by "delete_volume" :: held 0.987s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Created reservations ['28856e65-b407-4b71-b5b0-648ab536f035'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Created reservations ['85999b8b-72f5-4763-88d3-55a605bfd66f', '2a734007-3e7d-4a50-8c7a-6bf14f47f5aa', '8514217e-3820-4557-a9ac-11d53f41a417', '0b1b97ee-0dd4-40ae-8fce-2caf20b52901'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:57:58 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:57:58 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:57:58 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:57:58 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:57:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c8735057-fa42-4e3e-ac7d-f95be9f8edec tempest-GroupsV314Test-573557604 None] Delete group completed successfully. Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (ebdeabad-4b3a-4d02-805b-452b34a50e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f10723-5250-4103-8012-eb9a775fb7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f10723-5250-4103-8012-eb9a775fb7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-739392667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c4b330-c414-44e9-867b-a46233063ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:04Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f380ecba-55b2-4655-8d32-79ff277b5a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f380ecba-55b2-4655-8d32-79ff277b5a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cce084-016d-4261-a920-f720ce69d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2cce084-016d-4261-a920-f720ce69d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c4b330-c414-44e9-867b-a46233063ac0', 'volume_name': 'volume-c2c4b330-c414-44e9-867b-a46233063ac0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4c84ee-816f-45ba-b05f-f7e04e923257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4c84ee-816f-45ba-b05f-f7e04e923257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885d3379-7ca1-4e78-9aee-acd0d4a6a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:03 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Volume c2c4b330-c414-44e9-867b-a46233063ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c4b330-c414-44e9-867b-a46233063ac0', 'volume_size': 1} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-739392667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c4b330-c414-44e9-867b-a46233063ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:04Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Creating volume c2c4b330-c414-44e9-867b-a46233063ac0 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:04 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:04 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 1073741824 Sep 25 17:58:04 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:05 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 1073741824" returned: 0 in 1.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:05 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 Sep 25 17:58:05 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:06 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0" returned: 0 in 0.638s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885d3379-7ca1-4e78-9aee-acd0d4a6a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c4b330-c414-44e9-867b-a46233063ac0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b90e7a6-512b-468b-9fef-9ff423f1d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Volume volume-c2c4b330-c414-44e9-867b-a46233063ac0 (c2c4b330-c414-44e9-867b-a46233063ac0): created successfully Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b90e7a6-512b-468b-9fef-9ff423f1d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (ebdeabad-4b3a-4d02-805b-452b34a50e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:06 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c190495e-8658-4ae4-8e8f-baea5f9ceec5 tempest-VolumesActionsTest-2090878656 None] Created volume successfully. Sep 25 17:58:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8dbde47-814f-4374-b5fa-ba67e17c075e tempest-VolumesActionsTest-2090878656 None] Acquiring lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0" by "attach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8dbde47-814f-4374-b5fa-ba67e17c075e tempest-VolumesActionsTest-2090878656 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0" acquired by "attach_volume" :: waited 0.053s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d8dbde47-814f-4374-b5fa-ba67e17c075e tempest-VolumesActionsTest-2090878656 None] Attaching volume c2c4b330-c414-44e9-867b-a46233063ac0 to instance f7ce6600-236e-4d53-974f-c6e8e30e86c8 at mountpoint /dev/vdb on host None. Sep 25 17:58:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d8dbde47-814f-4374-b5fa-ba67e17c075e tempest-VolumesActionsTest-2090878656 None] Attach volume completed successfully. Sep 25 17:58:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8dbde47-814f-4374-b5fa-ba67e17c075e tempest-VolumesActionsTest-2090878656 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0" released by "attach_volume" :: held 0.254s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dd8b7f21-f269-4cd2-9649-b2b3be659d49 tempest-VolumesActionsTest-1132858788 None] Terminate volume connection completed successfully. Sep 25 17:58:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dd8b7f21-f269-4cd2-9649-b2b3be659d49 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-detach_volume" by "detach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dd8b7f21-f269-4cd2-9649-b2b3be659d49 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dd8b7f21-f269-4cd2-9649-b2b3be659d49 tempest-VolumesActionsTest-1132858788 None] Detaching volume c2c4b330-c414-44e9-867b-a46233063ac0 from instance f7ce6600-236e-4d53-974f-c6e8e30e86c8. Sep 25 17:58:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dd8b7f21-f269-4cd2-9649-b2b3be659d49 tempest-VolumesActionsTest-1132858788 None] Detach volume completed successfully. Sep 25 17:58:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dd8b7f21-f269-4cd2-9649-b2b3be659d49 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-detach_volume" released by "detach_volume" :: held 0.183s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-13fceff5-6c2f-4b28-8d43-410d63f3f361 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-detach_volume" by "detach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-13fceff5-6c2f-4b28-8d43-410d63f3f361 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-13fceff5-6c2f-4b28-8d43-410d63f3f361 tempest-VolumesActionsTest-2090878656 None] Volume detach called, but volume not attached. Sep 25 17:58:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-13fceff5-6c2f-4b28-8d43-410d63f3f361 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "cinder-quobyte-c2c4b330-c414-44e9-867b-a46233063ac0" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-quobyte-c2c4b330-c414-44e9-867b-a46233063ac0" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4716ef-cd44-49ed-bbc3-be34e6be2715]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:10 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 Sep 25 17:58:10 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:11 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0" returned: 0 in 0.928s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:11 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0 Sep 25 17:58:11 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:11 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c2c4b330-c414-44e9-867b-a46233063ac0" returned: 0 in 0.611s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-quobyte-c2c4b330-c414-44e9-867b-a46233063ac0" released by "delete_volume" :: held 1.639s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Created reservations ['3177a36e-376a-42c9-98d4-91ac7e870181', 'dbcac632-c2a8-47ab-8555-69e9e637c5ab', '27708aa3-bb11-41f4-88c1-bbd070a0a37b', '667108ec-d0cf-490e-be74-58e210fec9d2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:12 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:12 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:12 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.739s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Deleted volume successfully. Sep 25 17:58:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6a0f3163-8f5e-47de-835f-5c18522afa37 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-c2c4b330-c414-44e9-867b-a46233063ac0-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-b8adc034-ee88-4cfe-93a9-b785d6ce6f9c req-157cfb85-2b87-413b-9ef2-f568f7d33a0b tempest-AttachVolumeShelveTestJSON-1506652302 None] No connector for attachment 78c22490-b464-4890-aca9-a52c00a63e53; skipping storage backend terminate_connection call. {{(pid=86665) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 17:58:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-b8adc034-ee88-4cfe-93a9-b785d6ce6f9c req-157cfb85-2b87-413b-9ef2-f568f7d33a0b tempest-AttachVolumeShelveTestJSON-1506652302 None] Deleting attachment 78c22490-b464-4890-aca9-a52c00a63e53. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:58:17 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (025aaac5-3ade-471f-8a47-2df0ac210285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6155696-cb15-4d35-aa09-f08326fcaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6155696-cb15-4d35-aa09-f08326fcaa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480020163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90973927-560d-47ac-a4cc-24ac93c9fcb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:18Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315705e0-a0a2-4e99-abef-1bc91d3d1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315705e0-a0a2-4e99-abef-1bc91d3d1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332d3209-4ca9-48a9-9845-066990a266e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332d3209-4ca9-48a9-9845-066990a266e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90973927-560d-47ac-a4cc-24ac93c9fcb6', 'volume_name': 'volume-90973927-560d-47ac-a4cc-24ac93c9fcb6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b9003e-36cc-4375-a5ea-1ca943836e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b9003e-36cc-4375-a5ea-1ca943836e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc378af-0136-42e8-839b-2afd3181b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:18 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Volume 90973927-560d-47ac-a4cc-24ac93c9fcb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90973927-560d-47ac-a4cc-24ac93c9fcb6', 'volume_size': 1} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480020163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90973927-560d-47ac-a4cc-24ac93c9fcb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:18Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Creating volume 90973927-560d-47ac-a4cc-24ac93c9fcb6 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:18 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:18 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 1073741824 Sep 25 17:58:18 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:18 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 1073741824" returned: 0 in 0.587s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:18 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 Sep 25 17:58:18 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:19 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6" returned: 0 in 0.385s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc378af-0136-42e8-839b-2afd3181b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90973927-560d-47ac-a4cc-24ac93c9fcb6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e1b26a-ca92-43c0-9ecd-8d502b3aade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Volume volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 (90973927-560d-47ac-a4cc-24ac93c9fcb6): created successfully Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e1b26a-ca92-43c0-9ecd-8d502b3aade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (025aaac5-3ade-471f-8a47-2df0ac210285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-eb29b94a-725b-4508-a034-ceb1bbd8f08e tempest-VolumesActionsTest-2090878656 None] Created volume successfully. Sep 25 17:58:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-90973927-560d-47ac-a4cc-24ac93c9fcb6-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-90973927-560d-47ac-a4cc-24ac93c9fcb6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-quobyte-90973927-560d-47ac-a4cc-24ac93c9fcb6" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-90973927-560d-47ac-a4cc-24ac93c9fcb6" acquired by "delete_volume" :: waited 0.037s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d8049-e295-4757-95b3-7044c69353c9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:20 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 Sep 25 17:58:20 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:21 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6" returned: 0 in 0.721s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:21 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6 Sep 25 17:58:21 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:21 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-90973927-560d-47ac-a4cc-24ac93c9fcb6" returned: 0 in 0.447s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-90973927-560d-47ac-a4cc-24ac93c9fcb6" released by "delete_volume" :: held 1.271s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:21 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Created reservations ['bcd908a2-4f0a-46b2-901b-3ecf87003e47', '1c55421f-8426-4ecb-8949-7566ce887b55', '554a86b5-1e72-439f-8b80-dab4959092f5', 'eec069b0-1060-4186-8785-a0b9949eada6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:22 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:22 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:22 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Deleted volume successfully. Sep 25 17:58:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-31860006-cf64-4659-8e94-8c78df077695 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-90973927-560d-47ac-a4cc-24ac93c9fcb6-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (ebc99964-4152-4240-ac2f-5a5d00bde213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8863b975-d175-49fc-8f34-f381c74a4a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8863b975-d175-49fc-8f34-f381c74a4a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45532097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0da191-8e67-43ac-8889-d9c0ed1296df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:23Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eadc6f-58f4-420e-8bd3-d15c945bd881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eadc6f-58f4-420e-8bd3-d15c945bd881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd013d9-6246-4d3d-8fb6-3c024a724683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd013d9-6246-4d3d-8fb6-3c024a724683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec0da191-8e67-43ac-8889-d9c0ed1296df', 'volume_name': 'volume-ec0da191-8e67-43ac-8889-d9c0ed1296df', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15f5db0-bf17-46dc-b3a7-96217a750cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15f5db0-bf17-46dc-b3a7-96217a750cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18f2b1f-3918-4206-8a22-07c2f4cfc907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Volume ec0da191-8e67-43ac-8889-d9c0ed1296df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec0da191-8e67-43ac-8889-d9c0ed1296df', 'volume_size': 1} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45532097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0da191-8e67-43ac-8889-d9c0ed1296df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:23Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Creating volume ec0da191-8e67-43ac-8889-d9c0ed1296df {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:23 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:23 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df 1073741824 Sep 25 17:58:23 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:24 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df 1073741824" returned: 0 in 0.551s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=69,cinder:UPDATE=57,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=53,cinder:UPDATE=64,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:24 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df Sep 25 17:58:24 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:24 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df" returned: 0 in 0.290s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18f2b1f-3918-4206-8a22-07c2f4cfc907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec0da191-8e67-43ac-8889-d9c0ed1296df', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2536ca-304f-468b-a895-a0d457c2f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Volume volume-ec0da191-8e67-43ac-8889-d9c0ed1296df (ec0da191-8e67-43ac-8889-d9c0ed1296df): created successfully Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2536ca-304f-468b-a895-a0d457c2f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (ebc99964-4152-4240-ac2f-5a5d00bde213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e8f0bc23-316f-43f1-b0ba-8c929d9d1501 tempest-VolumesActionsTest-2090878656 None] Created volume successfully. Sep 25 17:58:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-ec0da191-8e67-43ac-8889-d9c0ed1296df-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-ec0da191-8e67-43ac-8889-d9c0ed1296df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-quobyte-ec0da191-8e67-43ac-8889-d9c0ed1296df" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-ec0da191-8e67-43ac-8889-d9c0ed1296df" acquired by "delete_volume" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[073c7393-cc10-42f6-8715-b7c4a35a49f7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:26 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df Sep 25 17:58:26 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Flow 'volume_create_manager' (f4786576-faf4-4677-9e10-a3a3c52d0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41478694-ca61-4340-be0b-29b96798f217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41478694-ca61-4340-be0b-29b96798f217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-979709700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3b4900-51cf-4f37-aaf6-fa15e50f8443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058d0c1b620b40c0aa6815e0ae7f9791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:26Z,use_quota=True,user_id='10d8f49754104a95bbc345199dabd579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce82a524-866d-4148-baaf-867a2bdb1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce82a524-866d-4148-baaf-867a2bdb1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc458e04-12bc-45d1-83b6-1d0f460927fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc458e04-12bc-45d1-83b6-1d0f460927fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3b4900-51cf-4f37-aaf6-fa15e50f8443', 'volume_name': 'volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177efc47-e867-4dc8-8a4b-1611aa48a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177efc47-e867-4dc8-8a4b-1611aa48a6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7969cfd-bd9e-44d5-bf05-bdd0bb429df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Volume 4c3b4900-51cf-4f37-aaf6-fa15e50f8443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443', 'volume_size': 1} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-979709700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3b4900-51cf-4f37-aaf6-fa15e50f8443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058d0c1b620b40c0aa6815e0ae7f9791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:26Z,use_quota=True,user_id='10d8f49754104a95bbc345199dabd579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Creating volume 4c3b4900-51cf-4f37-aaf6-fa15e50f8443 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:26 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:26 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 1073741824 Sep 25 17:58:26 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:26 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df" returned: 0 in 0.854s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:26 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df Sep 25 17:58:26 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:27 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ec0da191-8e67-43ac-8889-d9c0ed1296df" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-ec0da191-8e67-43ac-8889-d9c0ed1296df" released by "delete_volume" :: held 1.263s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Created reservations ['72ba6327-43ea-49f8-a765-deb42c5cf590', '91e1f0cf-88c0-4ce7-9895-54e876b30e2e', '6669bdcb-2230-4bdb-b7ba-4155922f1d96', '15a0cc71-d1e9-45ff-baac-28a5947b5032'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:27 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 1073741824" returned: 0 in 0.627s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:27 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 Sep 25 17:58:27 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:27 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:27 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:27 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443" returned: 0 in 0.286s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7969cfd-bd9e-44d5-bf05-bdd0bb429df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0beeac-c86f-4f1e-9750-c6fb3d781a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:27 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Volume volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 (4c3b4900-51cf-4f37-aaf6-fa15e50f8443): created successfully Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0beeac-c86f-4f1e-9750-c6fb3d781a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Flow 'volume_create_manager' (f4786576-faf4-4677-9e10-a3a3c52d0139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a4cbd42a-2004-4072-a1bb-e8e3780e99ac tempest-VolumeQuotasAdminTestJSON-1575633811 None] Created volume successfully. Sep 25 17:58:27 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.322s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Deleted volume successfully. Sep 25 17:58:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-da568f85-e611-472f-a2c6-6eb18b4f2309 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-ec0da191-8e67-43ac-8889-d9c0ed1296df-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "cinder-4c3b4900-51cf-4f37-aaf6-fa15e50f8443-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "cinder-4c3b4900-51cf-4f37-aaf6-fa15e50f8443-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "cinder-quobyte-4c3b4900-51cf-4f37-aaf6-fa15e50f8443" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "cinder-quobyte-4c3b4900-51cf-4f37-aaf6-fa15e50f8443" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b179c852-fbe9-4908-afa4-6c53a0d79503]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (d2faec4c-833f-44a9-a791-d07bb0e48d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1a75ce-63d9-4ad5-95b2-5e82d880965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1a75ce-63d9-4ad5-95b2-5e82d880965f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1161282749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615be659-c8de-4c5a-b7ad-82d45740faab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:29Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f336a5f-07f5-41b0-b565-aa1c08f1a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f336a5f-07f5-41b0-b565-aa1c08f1a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:29 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569b68eb-42bf-465f-9a12-951f4553f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:29 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569b68eb-42bf-465f-9a12-951f4553f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615be659-c8de-4c5a-b7ad-82d45740faab', 'volume_name': 'volume-615be659-c8de-4c5a-b7ad-82d45740faab', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6eb75c-b9a9-44b1-99f4-49f3b6d7b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6eb75c-b9a9-44b1-99f4-49f3b6d7b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a99ded-2342-4d5d-8f81-cca30aed2f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Volume 615be659-c8de-4c5a-b7ad-82d45740faab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615be659-c8de-4c5a-b7ad-82d45740faab', 'volume_size': 1} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1161282749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615be659-c8de-4c5a-b7ad-82d45740faab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:29Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Creating volume 615be659-c8de-4c5a-b7ad-82d45740faab {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:29 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:29 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab 1073741824 Sep 25 17:58:29 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:29 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443" returned: 0 in 0.512s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:29 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443 Sep 25 17:58:29 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:29 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:29 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab 1073741824" returned: 0 in 0.593s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c3b4900-51cf-4f37-aaf6-fa15e50f8443" returned: 0 in 0.300s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "cinder-quobyte-4c3b4900-51cf-4f37-aaf6-fa15e50f8443" released by "delete_volume" :: held 0.933s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:30 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab Sep 25 17:58:30 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Created reservations ['86068883-bcc3-4a6d-879c-08210eec01a0', '832d240f-fa74-4367-9639-67fcbff98e71', '0862c47e-bf51-4782-a9b8-1e530fc62d27', 'b4ecd1cd-7e48-4e56-9631-3616a82a513a'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:30 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:30 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:30 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab" returned: 0 in 0.367s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a99ded-2342-4d5d-8f81-cca30aed2f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615be659-c8de-4c5a-b7ad-82d45740faab', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae3927b-c7e2-4cec-9e94-982fa52439bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Volume volume-615be659-c8de-4c5a-b7ad-82d45740faab (615be659-c8de-4c5a-b7ad-82d45740faab): created successfully Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae3927b-c7e2-4cec-9e94-982fa52439bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (d2faec4c-833f-44a9-a791-d07bb0e48d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ce9fe9c9-02dc-45a6-8d6b-d3fdb79fde4f tempest-VolumesActionsTest-2090878656 None] Created volume successfully. Sep 25 17:58:30 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.332s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Deleted volume successfully. Sep 25 17:58:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e463604c-6b57-4ac3-855a-2463615ab062 tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "cinder-4c3b4900-51cf-4f37-aaf6-fa15e50f8443-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-615be659-c8de-4c5a-b7ad-82d45740faab-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-615be659-c8de-4c5a-b7ad-82d45740faab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-quobyte-615be659-c8de-4c5a-b7ad-82d45740faab" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-615be659-c8de-4c5a-b7ad-82d45740faab" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[056a118a-05c8-4e76-954f-ce0317620a2b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:31 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab Sep 25 17:58:31 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:32 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab" returned: 0 in 0.501s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:32 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab Sep 25 17:58:32 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Flow 'volume_create_manager' (8536a9ff-f30c-4e45-a7c7-5ca3619cbfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a89cd5-c4ab-4b9b-b826-d0d64afbc45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a89cd5-c4ab-4b9b-b826-d0d64afbc45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-690655557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207fbd05-a567-41ec-b46a-b8129f519064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058d0c1b620b40c0aa6815e0ae7f9791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:32Z,use_quota=True,user_id='10d8f49754104a95bbc345199dabd579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1ae94b-0b3a-4f29-a36b-2c9ad4e3fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1ae94b-0b3a-4f29-a36b-2c9ad4e3fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76139f0-b7fd-41d5-8a35-fceaec5852e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76139f0-b7fd-41d5-8a35-fceaec5852e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207fbd05-a567-41ec-b46a-b8129f519064', 'volume_name': 'volume-207fbd05-a567-41ec-b46a-b8129f519064', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001381dd-1bc7-47a0-8e0c-b79fb137c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001381dd-1bc7-47a0-8e0c-b79fb137c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aa6a23-3647-4c29-89a3-4acd84bbe2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Volume 207fbd05-a567-41ec-b46a-b8129f519064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207fbd05-a567-41ec-b46a-b8129f519064', 'volume_size': 1} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-690655557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207fbd05-a567-41ec-b46a-b8129f519064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058d0c1b620b40c0aa6815e0ae7f9791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:32Z,use_quota=True,user_id='10d8f49754104a95bbc345199dabd579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Creating volume 207fbd05-a567-41ec-b46a-b8129f519064 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:32 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 1073741824 Sep 25 17:58:32 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:32 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-615be659-c8de-4c5a-b7ad-82d45740faab" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-615be659-c8de-4c5a-b7ad-82d45740faab" released by "delete_volume" :: held 0.870s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Created reservations ['5664e7e3-fbd3-458e-8b91-451f1c053608', '32cfa5f5-296e-40f8-b2d3-7025e3b1404a', 'b7e6daf9-5360-4527-9b6e-4905f1eacc7a', 'bd4dcf61-aead-4f42-905a-b2313033a802'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:32 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:32 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:32 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 1073741824" returned: 0 in 0.574s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:33 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Deleted volume successfully. Sep 25 17:58:33 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 Sep 25 17:58:33 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9572b84-e5cd-43b6-956e-d3218fab7166 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-615be659-c8de-4c5a-b7ad-82d45740faab-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:33 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aa6a23-3647-4c29-89a3-4acd84bbe2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207fbd05-a567-41ec-b46a-b8129f519064', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f37750-baac-49e3-9c1c-843ef3553279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Volume volume-207fbd05-a567-41ec-b46a-b8129f519064 (207fbd05-a567-41ec-b46a-b8129f519064): created successfully Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f37750-baac-49e3-9c1c-843ef3553279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Flow 'volume_create_manager' (8536a9ff-f30c-4e45-a7c7-5ca3619cbfb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (1a4ca973-1981-4c21-9a9e-774a4ca930ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d7eea-70b7-4c2f-9ec0-520c39ba3964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-891c426a-a034-4930-82ed-38830593f1cf tempest-VolumeQuotasAdminTestJSON-1575633811 None] Created volume successfully. Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d7eea-70b7-4c2f-9ec0-520c39ba3964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566192755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636ce493-aca4-4e19-8459-73218b7c8871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:33Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5e1509-74c9-490e-a388-8fac079ea4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5e1509-74c9-490e-a388-8fac079ea4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f118426-ce83-4400-bec8-60ff0087712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f118426-ce83-4400-bec8-60ff0087712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636ce493-aca4-4e19-8459-73218b7c8871', 'volume_name': 'volume-636ce493-aca4-4e19-8459-73218b7c8871', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa19fe07-bbcd-408e-9e54-4199541611e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa19fe07-bbcd-408e-9e54-4199541611e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5853196-1e9d-499a-9a47-7507eefb0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Volume 636ce493-aca4-4e19-8459-73218b7c8871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636ce493-aca4-4e19-8459-73218b7c8871', 'volume_size': 1} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566192755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636ce493-aca4-4e19-8459-73218b7c8871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:33Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Creating volume 636ce493-aca4-4e19-8459-73218b7c8871 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:33 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:33 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 1073741824 Sep 25 17:58:33 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:33 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 1073741824" returned: 0 in 0.405s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:33 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 Sep 25 17:58:33 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:34 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5853196-1e9d-499a-9a47-7507eefb0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636ce493-aca4-4e19-8459-73218b7c8871', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da72348-baba-4646-9fcf-81f8f8a325c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Volume volume-636ce493-aca4-4e19-8459-73218b7c8871 (636ce493-aca4-4e19-8459-73218b7c8871): created successfully Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da72348-baba-4646-9fcf-81f8f8a325c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (1a4ca973-1981-4c21-9a9e-774a4ca930ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-98b725e6-56bf-447a-8207-179053d52dac tempest-VolumesActionsTest-2090878656 None] Created volume successfully. Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-636ce493-aca4-4e19-8459-73218b7c8871-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-636ce493-aca4-4e19-8459-73218b7c8871-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "cinder-quobyte-636ce493-aca4-4e19-8459-73218b7c8871" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-636ce493-aca4-4e19-8459-73218b7c8871" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f781323-8649-4531-8fc8-327166eabfc3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:34 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 Sep 25 17:58:34 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:35 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871" returned: 0 in 0.448s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-381271c9-7105-4a38-8125-15c09aeb9405 tempest-VolumeQuotasAdminTestJSON-140546047 None] Transfer volume completed successfully. Sep 25 17:58:35 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871 Sep 25 17:58:35 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:35 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-636ce493-aca4-4e19-8459-73218b7c8871" returned: 0 in 0.275s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-quobyte-636ce493-aca4-4e19-8459-73218b7c8871" released by "delete_volume" :: held 0.771s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Created reservations ['230992cf-3f94-4d26-ab79-1bd4ed1d4345', 'b31c94a5-a997-4a7e-a340-ccd007c77c83', '31f0d5fd-d8c9-4b7a-8192-3beb0f73894c', 'ded1e940-7f67-4a8a-88a5-d5487a597af6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:35 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:35 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:35 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Acquiring lock "cinder-207fbd05-a567-41ec-b46a-b8129f519064-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Deleted volume successfully. Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Lock "cinder-207fbd05-a567-41ec-b46a-b8129f519064-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c54e6133-87fe-4676-a031-774f7a8f9c91 tempest-VolumesActionsTest-1132858788 None] Lock "cinder-636ce493-aca4-4e19-8459-73218b7c8871-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Acquiring lock "cinder-quobyte-207fbd05-a567-41ec-b46a-b8129f519064" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Lock "cinder-quobyte-207fbd05-a567-41ec-b46a-b8129f519064" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c2685-3b76-42aa-afcf-c19253f9f456]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:36 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 Sep 25 17:58:36 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:36 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (f2dc5b08-8b7c-4f7e-9b95-6f12580759cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe04e0d8-4a94-40a5-ba6c-230a708dfda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064" returned: 0 in 0.483s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe04e0d8-4a94-40a5-ba6c-230a708dfda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1789814776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d0252c-a0e5-4ac3-b4cc-1127861a113a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:36Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aa14da-c880-4a42-8bb0-9175e5f0769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:36 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064 Sep 25 17:58:36 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aa14da-c880-4a42-8bb0-9175e5f0769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21971714-65c1-43be-bdad-02a05331812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21971714-65c1-43be-bdad-02a05331812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d0252c-a0e5-4ac3-b4cc-1127861a113a', 'volume_name': 'volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286a2327-883f-4d1c-8634-033c69fc1d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286a2327-883f-4d1c-8634-033c69fc1d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a12929-ff67-42da-888e-f77f70ba26b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:36 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Volume 96d0252c-a0e5-4ac3-b4cc-1127861a113a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a', 'volume_size': 1} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1789814776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d0252c-a0e5-4ac3-b4cc-1127861a113a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a493c643734ddca01a785af424b7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:36Z,use_quota=True,user_id='db64995226ba44e880227ac3f415bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Creating volume 96d0252c-a0e5-4ac3-b4cc-1127861a113a {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:36 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:36 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a 1073741824 Sep 25 17:58:36 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:36 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-207fbd05-a567-41ec-b46a-b8129f519064" returned: 0 in 0.261s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Lock "cinder-quobyte-207fbd05-a567-41ec-b46a-b8129f519064" released by "delete_volume" :: held 0.790s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Created reservations ['a292117c-b1df-4b16-94be-b4b2ffaf4a69', '6396eda3-0e00-45d3-a229-caeea1ecc82e', 'be0ff523-e64c-4944-a5e2-5c9fb8d24784', 'e7655afc-9112-41c4-abda-0971d0385e44'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:36 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:36 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:37 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a 1073741824" returned: 0 in 0.588s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:37 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a Sep 25 17:58:37 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:37 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.323s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Deleted volume successfully. Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8a8bfa3b-3ead-4f53-974d-06888f65d858 tempest-VolumeQuotasAdminTestJSON-1019977505 None] Lock "cinder-207fbd05-a567-41ec-b46a-b8129f519064-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:37 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a" returned: 0 in 0.339s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a12929-ff67-42da-888e-f77f70ba26b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4e497-c9a4-449e-9baf-f38955c7b3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:37 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Volume volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a (96d0252c-a0e5-4ac3-b4cc-1127861a113a): created successfully Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d4e497-c9a4-449e-9baf-f38955c7b3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Flow 'volume_create_manager' (f2dc5b08-8b7c-4f7e-9b95-6f12580759cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cc8247ad-e5d8-44e2-8310-2fb3254349c0 tempest-VolumesActionsTest-2090878656 None] Created volume successfully. Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "cinder-96d0252c-a0e5-4ac3-b4cc-1127861a113a-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-96d0252c-a0e5-4ac3-b4cc-1127861a113a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "cinder-quobyte-96d0252c-a0e5-4ac3-b4cc-1127861a113a" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-quobyte-96d0252c-a0e5-4ac3-b4cc-1127861a113a" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77a024-f549-4f0f-a163-e7e21d3d2371]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:39 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a Sep 25 17:58:39 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:39 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a" returned: 0 in 0.440s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:39 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a Sep 25 17:58:39 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:40 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-96d0252c-a0e5-4ac3-b4cc-1127861a113a" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-quobyte-96d0252c-a0e5-4ac3-b4cc-1127861a113a" released by "delete_volume" :: held 0.830s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Created reservations ['15ca2760-758f-4bfe-bbc1-fc304ce44285', '099f6fd0-a823-41ec-89d2-9ae16f60cffe', '6ccc45a5-4ffc-4e02-9854-60665d8798a0', '7958cbf6-079a-450e-8a67-640df5f75207'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:40 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:40 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:40 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.441s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Deleted volume successfully. Sep 25 17:58:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-36a0ef7d-9bad-4949-a20b-0eb0628d38d0 tempest-VolumesActionsTest-2090878656 None] Lock "cinder-96d0252c-a0e5-4ac3-b4cc-1127861a113a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Flow 'volume_create_manager' (029b72fc-6c28-4045-9f4c-c34b67aa4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ee6f8b-aec3-48ee-9ce6-776cde8de151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ee6f8b-aec3-48ee-9ce6-776cde8de151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1973600698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cee6d3d-2204-4cd9-9d34-fb431bdf808f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25dfa90388747fb896ae39493e70ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:45Z,use_quota=True,user_id='9f0b548c2a2b44e3879c351357bbd417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54b7a52c-ca03-4a9d-b295-100f5df530c0),volume_type_id=54b7a52c-ca03-4a9d-b295-100f5df530c0)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13eaf769-460f-4bcf-b74a-3f90a137f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13eaf769-460f-4bcf-b74a-3f90a137f903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42f89ca-01c8-4b69-8a64-d1e33ad5de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42f89ca-01c8-4b69-8a64-d1e33ad5de8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cee6d3d-2204-4cd9-9d34-fb431bdf808f', 'volume_name': 'volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d58674a-9911-451b-9ddf-312086bd56fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d58674a-9911-451b-9ddf-312086bd56fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf3581e-e202-4744-9c41-afb138487d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:45 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Volume 3cee6d3d-2204-4cd9-9d34-fb431bdf808f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f', 'volume_size': 1} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1973600698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cee6d3d-2204-4cd9-9d34-fb431bdf808f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25dfa90388747fb896ae39493e70ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:45Z,use_quota=True,user_id='9f0b548c2a2b44e3879c351357bbd417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54b7a52c-ca03-4a9d-b295-100f5df530c0),volume_type_id=54b7a52c-ca03-4a9d-b295-100f5df530c0)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Creating volume 3cee6d3d-2204-4cd9-9d34-fb431bdf808f {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:45 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:45 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f 1073741824 Sep 25 17:58:45 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:46 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f 1073741824" returned: 0 in 0.662s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:46 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f Sep 25 17:58:46 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:46 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f" returned: 0 in 0.300s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf3581e-e202-4744-9c41-afb138487d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68445a45-c4de-4f62-9e8a-99e3bd8301ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:46 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Volume volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f (3cee6d3d-2204-4cd9-9d34-fb431bdf808f): created successfully Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68445a45-c4de-4f62-9e8a-99e3bd8301ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Flow 'volume_create_manager' (029b72fc-6c28-4045-9f4c-c34b67aa4f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5cf9e014-8780-4e4e-b841-36e4fb93b778 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Created volume successfully. Sep 25 17:58:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-1ea82211-b6a9-4166-8424-f7674a34d338 tempest-ServerActionsTestOtherA-1248889968 None] Terminate volume connection completed successfully. Sep 25 17:58:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-1ea82211-b6a9-4166-8424-f7674a34d338 tempest-ServerActionsTestOtherA-1248889968 None] Deleting attachment 520d478b-6507-4574-b883-c8b936aa8ada. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:58:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "cinder-adc91da0-520d-4463-bc9a-f0eb3af3fad5-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-adc91da0-520d-4463-bc9a-f0eb3af3fad5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "cinder-quobyte-adc91da0-520d-4463-bc9a-f0eb3af3fad5" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-quobyte-adc91da0-520d-4463-bc9a-f0eb3af3fad5" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70dc68-23dd-4174-9cf0-7dce9c4ef809]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:48 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:48 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:48 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 Sep 25 17:58:48 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:48 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.347s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f60154bb-c17f-4e34-8967-373ff8e3aced tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Retype volume completed successfully. Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:48 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:48 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5 Sep 25 17:58:48 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:48 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-adc91da0-520d-4463-bc9a-f0eb3af3fad5" returned: 0 in 0.302s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-quobyte-adc91da0-520d-4463-bc9a-f0eb3af3fad5" released by "delete_volume" :: held 0.827s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.quota [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Created reservations ['2b2e8980-f9cf-4905-b78b-2ca38e5891e1', 'be5d49d7-c337-44e9-948b-a3f0c000f5e0', 'd734bed7-6062-4fe8-ad5c-039e352a0a8e', '401c2287-b9f7-4a39-b37c-4e41eed9cadc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "cinder-3360369a-795d-4cd2-9afc-02ce0b8a9ee8-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-3360369a-795d-4cd2-9afc-02ce0b8a9ee8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:49 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:49 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "cinder-quobyte-3360369a-795d-4cd2-9afc-02ce0b8a9ee8" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-quobyte-3360369a-795d-4cd2-9afc-02ce0b8a9ee8" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af3c9e0-923b-49e1-ace6-1923d64714e9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:49 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 Sep 25 17:58:49 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Acquiring lock "cinder-3cee6d3d-2204-4cd9-9d34-fb431bdf808f-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "cinder-3cee6d3d-2204-4cd9-9d34-fb431bdf808f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Acquiring lock "cinder-quobyte-3cee6d3d-2204-4cd9-9d34-fb431bdf808f" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "cinder-quobyte-3cee6d3d-2204-4cd9-9d34-fb431bdf808f" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:49 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.372s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.manager [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Deleted volume successfully. Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46778fb-4a64-4791-b67e-b9a565312b8c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-5e52da9b-bf6d-46ee-87f7-f92f8b7ced2d req-db7e9852-5059-4c70-a31c-59256fcc125f tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-adc91da0-520d-4463-bc9a-f0eb3af3fad5-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:49 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8" returned: 0 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:49 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f Sep 25 17:58:49 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:49 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8 Sep 25 17:58:49 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:49 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3360369a-795d-4cd2-9afc-02ce0b8a9ee8" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:49 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-quobyte-3360369a-795d-4cd2-9afc-02ce0b8a9ee8" released by "delete_volume" :: held 0.865s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f" returned: 0 in 0.538s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:49 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f Sep 25 17:58:49 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Created reservations ['a24228ca-2fc2-4f45-a6e7-a1c753da08e8', 'adc8ff03-ac6f-4518-b1a7-ec0269c90e99', '2050ac83-156e-4711-acba-440c5506b57b', '4f7a9f0f-e1ed-4e4d-bf38-04cb398cae73'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:50 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:50 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:50 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cee6d3d-2204-4cd9-9d34-fb431bdf808f" returned: 0 in 0.388s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "cinder-quobyte-3cee6d3d-2204-4cd9-9d34-fb431bdf808f" released by "delete_volume" :: held 0.994s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:50 devstack cinder-volume[86665]: WARNING cinder.quota [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:58:50 devstack cinder-volume[86665]: WARNING cinder.quota [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Created reservations ['097f6029-aca2-4f06-85ec-d0d67a960047', '639d449c-b546-4e46-be5d-dd69926b9096', '7354dace-1151-49a7-90ed-804af547c93a', '8c3a14a3-64e4-4ceb-8080-b0de039b0bf6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:50 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.409s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Deleted volume successfully. Sep 25 17:58:50 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:50 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a53818c5-3da1-44a3-a802-69a4bf460280 tempest-ServerActionsTestOtherA-1248889968 None] Lock "cinder-3360369a-795d-4cd2-9afc-02ce0b8a9ee8-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:51 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.471s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:51 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Deleted volume successfully. Sep 25 17:58:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bda34d7c-7c82-4034-a925-59b399cd2ec6 tempest-VolumeRetypeWithoutMigrationTest-1740393190 None] Lock "cinder-3cee6d3d-2204-4cd9-9d34-fb431bdf808f-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:55 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:58:55 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:56 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:58:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:58:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:58:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Flow 'volume_create_manager' (5ed5e7f7-c3b2-499b-ad0e-a323e0892cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96e83fb-0c7c-4170-98f5-71251f0e7141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96e83fb-0c7c-4170-98f5-71251f0e7141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-552553461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2522383-2c9f-4adc-9882-4410f4c6d70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6621e276d2c47fca4ba40dbd4d71edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:59Z,use_quota=True,user_id='230881ffea7642409ccac6690a4399f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8511833e-4148-462d-92c2-7d9e295df552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8511833e-4148-462d-92c2-7d9e295df552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8281d6-a5fd-4dde-9212-e8ca126da631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8281d6-a5fd-4dde-9212-e8ca126da631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2522383-2c9f-4adc-9882-4410f4c6d70b', 'volume_name': 'volume-b2522383-2c9f-4adc-9882-4410f4c6d70b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7deeee0e-12ad-4367-9060-d08757446f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7deeee0e-12ad-4367-9060-d08757446f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02678041-3ffe-4983-8b73-12484e5fcafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:58:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Volume b2522383-2c9f-4adc-9882-4410f4c6d70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2522383-2c9f-4adc-9882-4410f4c6d70b', 'volume_size': 1} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-552553461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2522383-2c9f-4adc-9882-4410f4c6d70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6621e276d2c47fca4ba40dbd4d71edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:58:59Z,use_quota=True,user_id='230881ffea7642409ccac6690a4399f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Creating volume b2522383-2c9f-4adc-9882-4410f4c6d70b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:58:59 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Acquiring lock "cinder-114d78be-7255-4310-980e-316bd83b1db5-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:59 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b 1073741824 Sep 25 17:58:59 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "cinder-114d78be-7255-4310-980e-316bd83b1db5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Acquiring lock "cinder-quobyte-114d78be-7255-4310-980e-316bd83b1db5" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "cinder-quobyte-114d78be-7255-4310-980e-316bd83b1db5" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9bf859-5e6e-404b-aa28-9a57252f7e48]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:59 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 Sep 25 17:58:59 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:59 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b 1073741824" returned: 0 in 0.619s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:59 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5" returned: 0 in 0.511s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:58:59 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5 Sep 25 17:58:59 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:58:59 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b Sep 25 17:58:59 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:00 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-114d78be-7255-4310-980e-316bd83b1db5" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "cinder-quobyte-114d78be-7255-4310-980e-316bd83b1db5" released by "delete_volume" :: held 0.886s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:00 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b" returned: 0 in 0.367s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02678041-3ffe-4983-8b73-12484e5fcafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2522383-2c9f-4adc-9882-4410f4c6d70b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe9d9ca-534a-4ed3-a127-8ed967569917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Created reservations ['62750899-b8a8-427f-996d-0328bfcd1db2', 'b95b8cd4-53a9-45fc-afa5-ccb54261c869', '96fc47ac-9ccb-4a4e-bd08-4a4f8b47f9c4', '72ae1773-33c2-4c94-8408-d883b99b4bd6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Volume volume-b2522383-2c9f-4adc-9882-4410f4c6d70b (b2522383-2c9f-4adc-9882-4410f4c6d70b): created successfully Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe9d9ca-534a-4ed3-a127-8ed967569917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Flow 'volume_create_manager' (5ed5e7f7-c3b2-499b-ad0e-a323e0892cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7aa3af16-d4ca-4607-aa81-44e095978b2b tempest-VolumesListAdminTestJSON-35754080 None] Created volume successfully. Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:00 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:00 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:00 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.367s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Deleted volume successfully. Sep 25 17:59:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-06a3c2dd-ec9f-4055-8696-013c31d7d086 tempest-AttachVolumeShelveTestJSON-1506652302 None] Lock "cinder-114d78be-7255-4310-980e-316bd83b1db5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Flow 'volume_create_manager' (e77cfe4e-8051-42aa-ab8a-78cfda4a6f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5298a7-64b6-4b31-b2ec-3988a530a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5298a7-64b6-4b31-b2ec-3988a530a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1826911791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f759163-8f6e-4704-bf4f-dd185cffb174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087ecf4e236a46b8989b9e2d66a26d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:01Z,use_quota=True,user_id='4da587e47d644a2a96f71ccbbd575c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91f8afe-69b8-47bf-8f6e-d191d856f1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91f8afe-69b8-47bf-8f6e-d191d856f1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0faa15-451a-4eee-ad96-2c1223034f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0faa15-451a-4eee-ad96-2c1223034f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f759163-8f6e-4704-bf4f-dd185cffb174', 'volume_name': 'volume-6f759163-8f6e-4704-bf4f-dd185cffb174', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ace779-1fa7-434c-8dc9-16454642aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ace779-1fa7-434c-8dc9-16454642aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebefa46b-f10b-4463-9412-2f6660827b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Volume 6f759163-8f6e-4704-bf4f-dd185cffb174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f759163-8f6e-4704-bf4f-dd185cffb174', 'volume_size': 1} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1826911791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f759163-8f6e-4704-bf4f-dd185cffb174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087ecf4e236a46b8989b9e2d66a26d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:01Z,use_quota=True,user_id='4da587e47d644a2a96f71ccbbd575c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Creating volume 6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:01 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 1073741824 Sep 25 17:59:01 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Flow 'volume_create_manager' (49f3080b-0b65-49eb-8283-9a83b2d4bfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c79359-52cb-4757-aadf-dc8c00596537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c79359-52cb-4757-aadf-dc8c00596537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-157295073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5db8cf3-7c5b-4844-960f-abc66b011329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6621e276d2c47fca4ba40dbd4d71edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:02Z,use_quota=True,user_id='230881ffea7642409ccac6690a4399f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924d95b2-b534-42ab-bdeb-c5d82c7302a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924d95b2-b534-42ab-bdeb-c5d82c7302a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb104f8-d78e-4202-b075-ed799c308597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb104f8-d78e-4202-b075-ed799c308597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5db8cf3-7c5b-4844-960f-abc66b011329', 'volume_name': 'volume-d5db8cf3-7c5b-4844-960f-abc66b011329', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03adefad-e3d9-4b3b-937e-a12e456ca44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03adefad-e3d9-4b3b-937e-a12e456ca44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174c3fb1-3e6b-43e6-a246-d36089127f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Volume d5db8cf3-7c5b-4844-960f-abc66b011329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5db8cf3-7c5b-4844-960f-abc66b011329', 'volume_size': 1} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 1073741824" returned: 0 in 0.812s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:02 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 Sep 25 17:59:02 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:02 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174" returned: 0 in 0.385s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-157295073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5db8cf3-7c5b-4844-960f-abc66b011329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6621e276d2c47fca4ba40dbd4d71edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:02Z,use_quota=True,user_id='230881ffea7642409ccac6690a4399f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Creating volume d5db8cf3-7c5b-4844-960f-abc66b011329 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.056s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:02 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebefa46b-f10b-4463-9412-2f6660827b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f759163-8f6e-4704-bf4f-dd185cffb174', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97a0886-a4ba-4a7f-8599-a122cae13846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:02 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 1073741824 Sep 25 17:59:02 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Volume volume-6f759163-8f6e-4704-bf4f-dd185cffb174 (6f759163-8f6e-4704-bf4f-dd185cffb174): created successfully Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97a0886-a4ba-4a7f-8599-a122cae13846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Flow 'volume_create_manager' (e77cfe4e-8051-42aa-ab8a-78cfda4a6f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2541922a-2ec4-4df3-9eff-ff212749e2fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Created volume successfully. Sep 25 17:59:03 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 1073741824" returned: 0 in 0.620s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:03 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 Sep 25 17:59:03 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:03 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329" returned: 0 in 0.354s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.048s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174c3fb1-3e6b-43e6-a246-d36089127f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5db8cf3-7c5b-4844-960f-abc66b011329', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0a938a-6aa3-4793-9463-ec90aa264b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Creating offline snapshot 1563d113-c7f3-4387-bfec-d5a6f2876fce of volume 6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:59:03 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Volume volume-d5db8cf3-7c5b-4844-960f-abc66b011329 (d5db8cf3-7c5b-4844-960f-abc66b011329): created successfully Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0a938a-6aa3-4793-9463-ec90aa264b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Flow 'volume_create_manager' (49f3080b-0b65-49eb-8283-9a83b2d4bfe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4273d4a7-16d1-47c9-9124-bbc1fde9fc1e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:03 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-14fe98d1-ebfb-464f-b003-8c626593591e tempest-VolumesListAdminTestJSON-35754080 None] Created volume successfully. Sep 25 17:59:03 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 Sep 25 17:59:03 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:04 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174" returned: 0 in 0.521s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:04 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce 1G Sep 25 17:59:04 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Flow 'volume_create_manager' (147fef55-dabf-4162-bb08-066aeac92ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340b6be8-0251-4fbb-bfd7-92536baa2375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (340b6be8-0251-4fbb-bfd7-92536baa2375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553387340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ddc77b-d259-42d2-8329-48813346ee05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6621e276d2c47fca4ba40dbd4d71edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:04Z,use_quota=True,user_id='230881ffea7642409ccac6690a4399f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34959240-87e3-456e-8cc9-d4d7bee96e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34959240-87e3-456e-8cc9-d4d7bee96e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c0eae1-7697-43bf-a446-72d68ca01971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c0eae1-7697-43bf-a446-72d68ca01971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ddc77b-d259-42d2-8329-48813346ee05', 'volume_name': 'volume-a5ddc77b-d259-42d2-8329-48813346ee05', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4468f293-f816-4fd9-8246-9a890ae7aa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4468f293-f816-4fd9-8246-9a890ae7aa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c470c00-48df-496b-aaa2-dcfc6647b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:04 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Volume a5ddc77b-d259-42d2-8329-48813346ee05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ddc77b-d259-42d2-8329-48813346ee05', 'volume_size': 1} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:04 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce 1G" returned: 0 in 0.505s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f759163-8f6e-4704-bf4f-dd185cffb174 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:04 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f759163-8f6e-4704-bf4f-dd185cffb174 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce Sep 25 17:59:04 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:04 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f759163-8f6e-4704-bf4f-dd185cffb174 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce" returned: 0 in 0.390s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:04 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce is being set with open permissions: ugo+rw Sep 25 17:59:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:05 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce Sep 25 17:59:05 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:05 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:05 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info Sep 25 17:59:05 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:05 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info" returned: 0 in 0.283s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:05 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info is being set with open permissions: ugo+rw Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:05 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info Sep 25 17:59:05 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:05 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.info" returned: 0 in 0.302s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553387340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ddc77b-d259-42d2-8329-48813346ee05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6621e276d2c47fca4ba40dbd4d71edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:04Z,use_quota=True,user_id='230881ffea7642409ccac6690a4399f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Creating volume a5ddc77b-d259-42d2-8329-48813346ee05 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:05 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:06 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 1073741824 Sep 25 17:59:06 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:06 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63dd16c0-8707-4aeb-9c1c-e3f2724e3a1a tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Create snapshot completed successfully Sep 25 17:59:06 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 1073741824" returned: 0 in 0.640s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:06 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 Sep 25 17:59:06 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:06 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05" returned: 0 in 0.335s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c470c00-48df-496b-aaa2-dcfc6647b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ddc77b-d259-42d2-8329-48813346ee05', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d62b4ae-dad2-41a3-b5a9-09b5d8a1ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Volume volume-a5ddc77b-d259-42d2-8329-48813346ee05 (a5ddc77b-d259-42d2-8329-48813346ee05): created successfully Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d62b4ae-dad2-41a3-b5a9-09b5d8a1ee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Flow 'volume_create_manager' (147fef55-dabf-4162-bb08-066aeac92ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a67e7dab-19fe-4c45-bd08-621e9cb3d816 tempest-VolumesListAdminTestJSON-35754080 None] Created volume successfully. Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "cinder-1563d113-c7f3-4387-bfec-d5a6f2876fce-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-1563d113-c7f3-4387-bfec-d5a6f2876fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "cinder-quobyte-6f759163-8f6e-4704-bf4f-dd185cffb174" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-quobyte-6f759163-8f6e-4704-bf4f-dd185cffb174" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "cinder-quobyte-1563d113-c7f3-4387-bfec-d5a6f2876fce" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-quobyte-1563d113-c7f3-4387-bfec-d5a6f2876fce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Deleting offline snapshot 1563d113-c7f3-4387-bfec-d5a6f2876fce of volume 6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] snapshot_file for this snap is: volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eebb864-d929-4c64-a661-7e10490013f1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:07 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce Sep 25 17:59:07 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:07 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce" returned: 0 in 0.487s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f759163-8f6e-4704-bf4f-dd185cffb174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b16d6-52d8-472c-bc51-bf41c123fb5d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:08 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 Sep 25 17:59:08 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:08 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174" returned: 0 in 0.529s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:08 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce Sep 25 17:59:08 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Flow 'volume_create_manager' (6190bbb4-266f-41b1-bf3c-5b13b8ac973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed571adc-1856-4ce6-b61a-1e050e3e174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed571adc-1856-4ce6-b61a-1e050e3e174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e2a7bb7d264ae08bedadd5d6c87508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:09Z,use_quota=True,user_id='85e896e1fcde40248ff781ce5f02697c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4274189-f05e-4c7e-a2a1-eaf69291bb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4274189-f05e-4c7e-a2a1-eaf69291bb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33b221f-7ca6-49e3-8ce9-56a81b99b811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33b221f-7ca6-49e3-8ce9-56a81b99b811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0', 'volume_name': 'volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d10ed8f-d8e4-489c-b33d-03c5f5d28ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d10ed8f-d8e4-489c-b33d-03c5f5d28ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7b9da8-ad5a-4e35-9a06-ca3829025c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Volume 1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0', 'volume_size': 1} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e2a7bb7d264ae08bedadd5d6c87508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:09Z,use_quota=True,user_id='85e896e1fcde40248ff781ce5f02697c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Creating volume 1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:08 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:08 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 1073741824 Sep 25 17:59:08 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:09 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce" returned: 0 in 0.573s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:09 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce Sep 25 17:59:09 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:09 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174.1563d113-c7f3-4387-bfec-d5a6f2876fce" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:09 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 1073741824" returned: 0 in 0.556s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-quobyte-1563d113-c7f3-4387-bfec-d5a6f2876fce" released by "_delete_snapshot" :: held 2.082s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-quobyte-6f759163-8f6e-4704-bf4f-dd185cffb174" released by "delete_snapshot" :: held 2.118s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:09 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 Sep 25 17:59:09 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Created reservations ['ca319971-686d-4091-be51-1469a078670f', 'e504d8d6-e4d8-4bda-93b4-56165b3079e0', '7565923d-64d1-4b6b-a393-5aa52002b664', 'a4c1d20d-0b13-4c71-a30d-12f25720e340'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Delete snapshot completed successfully. Sep 25 17:59:09 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0" returned: 0 in 0.314s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9e182225-97c3-40aa-ab42-bf865b4d2d4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-1563d113-c7f3-4387-bfec-d5a6f2876fce-delete_snapshot" released by "delete_snapshot" :: held 2.503s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7b9da8-ad5a-4e35-9a06-ca3829025c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a0e9bd-d428-4625-9445-54ab612c79e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:09 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Volume volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 (1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0): created successfully Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a0e9bd-d428-4625-9445-54ab612c79e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Flow 'volume_create_manager' (6190bbb4-266f-41b1-bf3c-5b13b8ac973e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8eae1bd0-e9aa-4c06-9d53-bf3d8314ecaa tempest-VolumesListAdminTestJSON-555970065 None] Created volume successfully. Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "cinder-6f759163-8f6e-4704-bf4f-dd185cffb174-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-6f759163-8f6e-4704-bf4f-dd185cffb174-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "cinder-quobyte-6f759163-8f6e-4704-bf4f-dd185cffb174" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-quobyte-6f759163-8f6e-4704-bf4f-dd185cffb174" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[794faf88-7b08-46d0-add8-bf8dcfa52fb2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Acquiring lock "cinder-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Lock "cinder-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Acquiring lock "cinder-quobyte-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Lock "cinder-quobyte-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:11 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 Sep 25 17:59:11 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33cc61f-5d10-4517-b409-3030cb79aa95]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "cinder-a5ddc77b-d259-42d2-8329-48813346ee05-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-a5ddc77b-d259-42d2-8329-48813346ee05-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "cinder-quobyte-a5ddc77b-d259-42d2-8329-48813346ee05" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-quobyte-a5ddc77b-d259-42d2-8329-48813346ee05" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b35dc-7be2-497b-a9ed-4c81a193f496]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:11 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 Sep 25 17:59:11 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:11 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174" returned: 0 in 0.562s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:11 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 Sep 25 17:59:11 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:11 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174 Sep 25 17:59:11 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:11 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0" returned: 0 in 0.581s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:11 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0 Sep 25 17:59:11 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:11 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f759163-8f6e-4704-bf4f-dd185cffb174" returned: 0 in 0.476s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-quobyte-6f759163-8f6e-4704-bf4f-dd185cffb174" released by "delete_volume" :: held 1.139s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:11 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05" returned: 0 in 0.733s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:12 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05 Sep 25 17:59:12 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Created reservations ['282b72dd-69de-4ed8-b546-c983d0a774cb', '73e1ffcb-cdf6-4176-8727-035af963633a', '0160ed40-3db7-4df1-9f83-aecc505d6b7d', '54d6c0f9-7379-41b5-b470-6fc61fe4bb0e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:12 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0" returned: 0 in 0.559s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Lock "cinder-quobyte-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0" released by "delete_volume" :: held 1.215s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:12 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:12 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Created reservations ['3c8e65fc-b613-4b09-8719-c1f12dde1447', 'b37822ca-7354-47bd-83eb-294db230a695', 'c84ad52c-7e8e-4386-9882-5b0b6e95da80', '6f918a37-fa09-42cd-aa22-d8841248bf2b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:12 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5ddc77b-d259-42d2-8329-48813346ee05" returned: 0 in 0.410s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-quobyte-a5ddc77b-d259-42d2-8329-48813346ee05" released by "delete_volume" :: held 1.236s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:12 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:12 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:12 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.319s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Created reservations ['a60e1d7d-1e58-4af1-950a-880558935fed', '370677a3-5d62-470a-9016-9cbadc9670db', '6df4d0b6-ce99-42bb-bd59-98fcc0c0f576', '34a116f2-ab96-4fde-9dad-5c13b317d570'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Deleted volume successfully. Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3dcf9c12-ddd1-4c59-a797-923f889f230d tempest-VolumeSnapshotQuotasNegativeTestJSON-1689087007 None] Lock "cinder-6f759163-8f6e-4704-bf4f-dd185cffb174-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:12 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:12 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:12 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Deleted volume successfully. Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-869fcf95-1c84-4c3e-9be2-2b09ecae9ffb tempest-VolumesListAdminTestJSON-555970065 None] Lock "cinder-1c9ea540-3517-4ef5-b0e9-c1f4b46d45f0-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:12 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Deleted volume successfully. Sep 25 17:59:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-33b6f6c7-3eba-41e3-b84a-eaa610159247 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-a5ddc77b-d259-42d2-8329-48813346ee05-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "cinder-d5db8cf3-7c5b-4844-960f-abc66b011329-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-d5db8cf3-7c5b-4844-960f-abc66b011329-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "cinder-quobyte-d5db8cf3-7c5b-4844-960f-abc66b011329" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-quobyte-d5db8cf3-7c5b-4844-960f-abc66b011329" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[943da9b4-7202-40c6-bd3d-49e164ab4dce]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:13 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 Sep 25 17:59:13 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:14 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329" returned: 0 in 0.551s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:14 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329 Sep 25 17:59:14 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:14 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d5db8cf3-7c5b-4844-960f-abc66b011329" returned: 0 in 0.360s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-quobyte-d5db8cf3-7c5b-4844-960f-abc66b011329" released by "delete_volume" :: held 0.977s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Created reservations ['42c4b462-fb87-409a-a819-fbcf046f6543', '9c06038a-d961-45da-8015-7c77e90c8f52', 'dd947e06-37bc-48e9-a890-5b887685f49a', '170d82cc-0c00-4f90-b8bf-c8f7ca324132'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:14 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:14 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:15 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.284s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:15 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Deleted volume successfully. Sep 25 17:59:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e9ac8866-63dc-4d96-bdf5-eb48daf863b1 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-d5db8cf3-7c5b-4844-960f-abc66b011329-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "cinder-b2522383-2c9f-4adc-9882-4410f4c6d70b-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-b2522383-2c9f-4adc-9882-4410f4c6d70b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "cinder-quobyte-b2522383-2c9f-4adc-9882-4410f4c6d70b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-quobyte-b2522383-2c9f-4adc-9882-4410f4c6d70b" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3a2f0-24d7-4b43-bce3-ea3a918feb10]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:16 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b Sep 25 17:59:16 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:16 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b" returned: 0 in 0.536s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:16 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b Sep 25 17:59:16 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:17 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b2522383-2c9f-4adc-9882-4410f4c6d70b" returned: 0 in 0.376s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-quobyte-b2522383-2c9f-4adc-9882-4410f4c6d70b" released by "delete_volume" :: held 0.991s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Created reservations ['deac906e-9343-4fef-be84-a4082d51d800', 'd49563a5-848e-4462-9374-229b2d67ebb3', 'cebb5b74-7e0d-4c60-82ff-4371077a822b', 'cb5efdb4-c9ec-40d1-8aef-6a0f75bac52f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:17 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:17 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:17 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.453s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Deleted volume successfully. Sep 25 17:59:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-42fc1f1c-d593-4853-acdd-04e104adf207 tempest-VolumesListAdminTestJSON-35754080 None] Lock "cinder-b2522383-2c9f-4adc-9882-4410f4c6d70b-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:27 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:DELETE=13,cinder:SELECT=123,cinder:UPDATE=161,cinder:INSERT=40 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:59:27 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=107,cinder:INSERT=37,cinder:UPDATE=172,cinder:DELETE=15 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Flow 'volume_create_manager' (bc503827-adf8-4c51-8db1-92a5906e91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0306dbd-bbeb-41f2-9e58-746a855f7b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0306dbd-bbeb-41f2-9e58-746a855f7b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1504472928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617e7a19-0c0b-4be7-aead-406f9a714ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5945a407cbdb4d03a24a06a3d888057c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:35Z,use_quota=True,user_id='43f06ec8e28e4fefbbfd9ff5493380ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7564e8-b308-47eb-a9fe-8e5b1b08f866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7564e8-b308-47eb-a9fe-8e5b1b08f866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0dfc57-50d7-42bb-aeb2-781321bba151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0dfc57-50d7-42bb-aeb2-781321bba151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617e7a19-0c0b-4be7-aead-406f9a714ff4', 'volume_name': 'volume-617e7a19-0c0b-4be7-aead-406f9a714ff4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc6e6ca-af81-446f-9e10-ae0d0b313c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc6e6ca-af81-446f-9e10-ae0d0b313c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07ab386-80a8-43ec-b7a4-0ac09ebb03a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:35 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Volume 617e7a19-0c0b-4be7-aead-406f9a714ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617e7a19-0c0b-4be7-aead-406f9a714ff4', 'volume_size': 1} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1504472928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617e7a19-0c0b-4be7-aead-406f9a714ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5945a407cbdb4d03a24a06a3d888057c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:35Z,use_quota=True,user_id='43f06ec8e28e4fefbbfd9ff5493380ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Creating volume 617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:35 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:35 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 1073741824 Sep 25 17:59:35 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:36 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 1073741824" returned: 0 in 1.084s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:36 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 Sep 25 17:59:36 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:36 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4" returned: 0 in 0.389s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07ab386-80a8-43ec-b7a4-0ac09ebb03a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617e7a19-0c0b-4be7-aead-406f9a714ff4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e7b584-c75e-4ea3-96d6-71d6b28e59e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:36 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Volume volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 (617e7a19-0c0b-4be7-aead-406f9a714ff4): created successfully Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e7b584-c75e-4ea3-96d6-71d6b28e59e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Flow 'volume_create_manager' (bc503827-adf8-4c51-8db1-92a5906e91fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4f933d29-ba64-4556-ab38-3278e40e5b05 tempest-SnapshotMetadataTestJSON-1551778341 None] Created volume successfully. Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Creating offline snapshot 79608dac-fe79-418e-b6de-435ab12f6535 of volume 617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc844a2-73a8-46c8-bf56-4ad66778f12d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:38 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 Sep 25 17:59:38 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:38 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4" returned: 0 in 0.767s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Flow 'volume_create_manager' (8c95b78c-df09-4e5c-8a5c-dadbf03391a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:38 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 1G Sep 25 17:59:38 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021f50d0-f0ff-4258-910e-26f2d799edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021f50d0-f0ff-4258-910e-26f2d799edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1013763324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70f0078-ce55-490a-ae67-4afe0a81238e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80beac8090646cbba2d109246a36d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:39Z,use_quota=True,user_id='1bb21bfd60c84cae8a507f2d12fe8d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bcd9dd-9bbb-4231-85b8-b5db5b87f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bcd9dd-9bbb-4231-85b8-b5db5b87f344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f66468-43dc-4dc3-9ad9-14900211de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f66468-43dc-4dc3-9ad9-14900211de93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70f0078-ce55-490a-ae67-4afe0a81238e', 'volume_name': 'volume-e70f0078-ce55-490a-ae67-4afe0a81238e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d286c477-f4c2-4603-a1a4-f2be25957433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d286c477-f4c2-4603-a1a4-f2be25957433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7d3afc-c08b-4071-8b62-4bc0ada19c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:38 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Volume e70f0078-ce55-490a-ae67-4afe0a81238e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70f0078-ce55-490a-ae67-4afe0a81238e', 'volume_size': 1} Sep 25 17:59:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:39 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 1G" returned: 0 in 0.993s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:39 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 Sep 25 17:59:39 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:40 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535" returned: 0 in 0.598s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:40 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 is being set with open permissions: ugo+rw Sep 25 17:59:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:40 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 Sep 25 17:59:40 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:40 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535" returned: 0 in 0.454s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:40 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info Sep 25 17:59:40 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:41 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:41 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info is being set with open permissions: ugo+rw Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:41 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info Sep 25 17:59:41 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:41 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.info" returned: 0 in 0.333s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.659s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.577s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1013763324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70f0078-ce55-490a-ae67-4afe0a81238e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80beac8090646cbba2d109246a36d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:39Z,use_quota=True,user_id='1bb21bfd60c84cae8a507f2d12fe8d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Creating volume e70f0078-ce55-490a-ae67-4afe0a81238e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:41 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:41 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e 1073741824 Sep 25 17:59:41 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-aad8a408-261c-4131-ac6b-41008970e73e tempest-SnapshotMetadataTestJSON-1551778341 None] Create snapshot completed successfully Sep 25 17:59:42 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e 1073741824" returned: 0 in 0.583s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:42 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e Sep 25 17:59:42 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:42 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e" returned: 0 in 0.659s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7d3afc-c08b-4071-8b62-4bc0ada19c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70f0078-ce55-490a-ae67-4afe0a81238e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373a6ead-60eb-4d69-9d78-9221f1bdaa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:42 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Volume volume-e70f0078-ce55-490a-ae67-4afe0a81238e (e70f0078-ce55-490a-ae67-4afe0a81238e): created successfully Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373a6ead-60eb-4d69-9d78-9221f1bdaa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Flow 'volume_create_manager' (8c95b78c-df09-4e5c-8a5c-dadbf03391a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4aacb798-ec51-41ae-962f-0f0446541802 tempest-AbsoluteLimitsTests-1924233377 None] Created volume successfully. Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "cinder-79608dac-fe79-418e-b6de-435ab12f6535-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-79608dac-fe79-418e-b6de-435ab12f6535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "cinder-quobyte-617e7a19-0c0b-4be7-aead-406f9a714ff4" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-quobyte-617e7a19-0c0b-4be7-aead-406f9a714ff4" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "cinder-quobyte-79608dac-fe79-418e-b6de-435ab12f6535" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-quobyte-79608dac-fe79-418e-b6de-435ab12f6535" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Deleting offline snapshot 79608dac-fe79-418e-b6de-435ab12f6535 of volume 617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] snapshot_file for this snap is: volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a54aec-5dcb-451d-b364-62cf7bd32c74]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:44 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 Sep 25 17:59:44 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:44 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535" returned: 0 in 0.539s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-617e7a19-0c0b-4be7-aead-406f9a714ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b6d73-e6fd-498f-95d7-3199c898aa97]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Acquiring lock "cinder-e70f0078-ce55-490a-ae67-4afe0a81238e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Lock "cinder-e70f0078-ce55-490a-ae67-4afe0a81238e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:44 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 Sep 25 17:59:44 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Acquiring lock "cinder-quobyte-e70f0078-ce55-490a-ae67-4afe0a81238e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Lock "cinder-quobyte-e70f0078-ce55-490a-ae67-4afe0a81238e" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef63b0-5a39-49b2-a580-ce1bf03911a7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:45 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e Sep 25 17:59:45 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:45 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4" returned: 0 in 0.806s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:45 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 Sep 25 17:59:45 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:45 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e" returned: 0 in 0.672s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:45 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e Sep 25 17:59:45 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:45 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535" returned: 0 in 0.746s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:46 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535 Sep 25 17:59:46 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:46 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e70f0078-ce55-490a-ae67-4afe0a81238e" returned: 0 in 0.563s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Lock "cinder-quobyte-e70f0078-ce55-490a-ae67-4afe0a81238e" released by "delete_volume" :: held 1.339s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Created reservations ['9e9e94a3-96c6-449a-a8c0-76d43586d73b', '2c2d91f9-def9-4dc3-83da-23861e8a7e9c', '43c8a927-6518-4368-b00d-6dc3ae5eb897', '14bd87a6-9721-4ebb-ad47-2fcd8c6939c3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:46 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4.79608dac-fe79-418e-b6de-435ab12f6535" returned: 0 in 0.421s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:46 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:46 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-quobyte-79608dac-fe79-418e-b6de-435ab12f6535" released by "_delete_snapshot" :: held 2.697s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-quobyte-617e7a19-0c0b-4be7-aead-406f9a714ff4" released by "delete_snapshot" :: held 2.744s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Created reservations ['8eec0d09-26c7-4a66-8d5c-25591c1e57c8', '9addcaa6-4f69-459a-8b87-f596b4570674', '0319f05c-e544-4a77-8a41-8f6257744632', '118d7a12-3fdd-484d-a918-5d83b5d0a208'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Delete snapshot completed successfully. Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-821d5bac-5f30-40d4-81e0-972b28d7040b tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-79608dac-fe79-418e-b6de-435ab12f6535-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:46 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.358s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Deleted volume successfully. Sep 25 17:59:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-114bbcfb-a001-4692-b552-e8cb51c91d07 tempest-AbsoluteLimitsTests-1924233377 None] Lock "cinder-e70f0078-ce55-490a-ae67-4afe0a81238e-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "cinder-617e7a19-0c0b-4be7-aead-406f9a714ff4-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-617e7a19-0c0b-4be7-aead-406f9a714ff4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "cinder-quobyte-617e7a19-0c0b-4be7-aead-406f9a714ff4" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-quobyte-617e7a19-0c0b-4be7-aead-406f9a714ff4" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496e0f1-9f47-4fd5-8a2a-31146c004c9c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:47 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 Sep 25 17:59:47 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:47 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4" returned: 0 in 0.477s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:47 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4 Sep 25 17:59:47 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:48 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-617e7a19-0c0b-4be7-aead-406f9a714ff4" returned: 0 in 0.316s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-quobyte-617e7a19-0c0b-4be7-aead-406f9a714ff4" released by "delete_volume" :: held 0.888s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Created reservations ['eb8be13c-a6d4-4dfc-a60b-b16b3ad7d06d', '9a639cb7-8234-4c7f-b9f3-f7a07ed49913', 'c88b1263-b46e-49ad-8d7f-185a5670068e', 'a766e62a-53bd-49ed-b1e4-eeb82f6fe92f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:48 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:48 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:48 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Deleted volume successfully. Sep 25 17:59:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-04e1d93c-6f35-4e57-a9ab-7afbf2e560c8 tempest-SnapshotMetadataTestJSON-1551778341 None] Lock "cinder-617e7a19-0c0b-4be7-aead-406f9a714ff4-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Flow 'volume_create_manager' (e2f21911-ead4-40ff-8435-0e99d8c5fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a0d461-57b1-47b1-ad26-8c25e67e0ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a0d461-57b1-47b1-ad26-8c25e67e0ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-775501309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54bcac2860f4080970a0d3a15fdc2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:53Z,use_quota=True,user_id='48e84a3e8eb04804b252b501b168cd2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e166eba3-7ffa-445e-aae9-2f25eb25a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e166eba3-7ffa-445e-aae9-2f25eb25a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedc150f-dd85-47b3-b63b-9967a9746e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedc150f-dd85-47b3-b63b-9967a9746e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d', 'volume_name': 'volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94b746d-ca1f-4019-951a-2ba8544660f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94b746d-ca1f-4019-951a-2ba8544660f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d13527a-e10a-4683-8eb2-316bf59735ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Volume 2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d', 'volume_size': 1} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-775501309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54bcac2860f4080970a0d3a15fdc2d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:53Z,use_quota=True,user_id='48e84a3e8eb04804b252b501b168cd2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Creating volume 2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:52 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:52 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d 1073741824 Sep 25 17:59:52 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:53 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d 1073741824" returned: 0 in 0.474s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:53 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d Sep 25 17:59:53 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:53 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d13527a-e10a-4683-8eb2-316bf59735ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a841269f-80a1-4f49-b177-85ce7a32bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:53 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Volume volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d (2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d): created successfully Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a841269f-80a1-4f49-b177-85ce7a32bd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Flow 'volume_create_manager' (e2f21911-ead4-40ff-8435-0e99d8c5fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-da58ad1b-c66e-4b9e-8b57-692337d38c67 tempest-VolumesMetadataTest-216162596 None] Created volume successfully. Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Flow 'volume_create_manager' (3c644b1c-49bd-4bcc-bcae-5465bcf7c345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572e4c12-f6ab-4d57-977c-c26ddf3323b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572e4c12-f6ab-4d57-977c-c26ddf3323b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1749197076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b039e43d-61e6-43ab-a3f3-7dacb31da48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6645fdb99f904123acd5e59346128b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:54Z,use_quota=True,user_id='d821f36eb6a7434893a45c844ff082ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c942973-b684-46b1-a7f9-c22044b20a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c942973-b684-46b1-a7f9-c22044b20a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087f1493-a6fd-4df6-b3ed-2f12b7873b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087f1493-a6fd-4df6-b3ed-2f12b7873b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b039e43d-61e6-43ab-a3f3-7dacb31da48e', 'volume_name': 'volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e283137-b88b-4c67-b099-7143931b9419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e283137-b88b-4c67-b099-7143931b9419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997719c8-9fec-49a3-b64d-aab0edc21b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:54 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Volume b039e43d-61e6-43ab-a3f3-7dacb31da48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e', 'volume_size': 1} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1749197076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b039e43d-61e6-43ab-a3f3-7dacb31da48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6645fdb99f904123acd5e59346128b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:59:54Z,use_quota=True,user_id='d821f36eb6a7434893a45c844ff082ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Creating volume b039e43d-61e6-43ab-a3f3-7dacb31da48e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:54 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:54 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e 1073741824 Sep 25 17:59:54 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:55 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e 1073741824" returned: 0 in 0.515s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:55 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e Sep 25 17:59:55 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:55 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e" returned: 0 in 0.277s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997719c8-9fec-49a3-b64d-aab0edc21b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045d69ce-1875-4b49-9886-e59b50b5efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:55 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Volume volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e (b039e43d-61e6-43ab-a3f3-7dacb31da48e): created successfully Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045d69ce-1875-4b49-9886-e59b50b5efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Flow 'volume_create_manager' (3c644b1c-49bd-4bcc-bcae-5465bcf7c345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7a6c5929-ebef-4251-85cd-947f54aaf5c6 tempest-VolumesTransfersV355Test-336271722 None] Created volume successfully. Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Acquiring lock "cinder-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Lock "cinder-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Acquiring lock "cinder-quobyte-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Lock "cinder-quobyte-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c2d53-0e7c-4fec-92be-94b03ef70259]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:55 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:55 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:56 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d Sep 25 17:59:56 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:56 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.351s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:59:56 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d" returned: 0 in 0.475s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:56 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d Sep 25 17:59:56 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:56 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d" returned: 0 in 0.278s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Lock "cinder-quobyte-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d" released by "delete_volume" :: held 0.813s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Created reservations ['5d23ee22-749d-4c7c-a3aa-55718e0fb8c9', 'bd2942a8-79c5-45a3-9b3f-1a9b0daad901', '1969e715-e53f-4c7b-aab5-3eba149888bc', '43406923-dae5-440f-b737-b1019194e885'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:56 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:56 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:57 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.296s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Deleted volume successfully. Sep 25 17:59:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d60fe3f1-afc0-4805-bc2d-4e986449b69e tempest-VolumesMetadataTest-216162596 None] Lock "cinder-2d98d8b1-d7e2-4d36-90d4-c26ef6b97f9d-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a0ec91ef-1a8e-4610-aac4-479058d85345 tempest-VolumesTransfersV355Test-825126354 None] Transfer volume completed successfully. Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Acquiring lock "cinder-b039e43d-61e6-43ab-a3f3-7dacb31da48e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-b039e43d-61e6-43ab-a3f3-7dacb31da48e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Acquiring lock "cinder-quobyte-b039e43d-61e6-43ab-a3f3-7dacb31da48e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-quobyte-b039e43d-61e6-43ab-a3f3-7dacb31da48e" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c14e1-0f4e-42a3-a869-aa0849b5e19b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:58 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e Sep 25 17:59:58 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:58 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:58 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e Sep 25 17:59:58 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:58 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b039e43d-61e6-43ab-a3f3-7dacb31da48e" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-quobyte-b039e43d-61e6-43ab-a3f3-7dacb31da48e" released by "delete_volume" :: held 0.698s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Created reservations ['ba92782d-d776-4ec6-822b-1db43c629fb3', '4094bec6-d70e-4989-9235-10a11737caad', '022a2946-826c-434c-bf69-8c37110420cb', '733eaf4c-3d28-4b86-8c1b-e39a5625a6ca'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:59 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 17:59:59 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:59:59 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.268s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:59:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Deleted volume successfully. Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb9b8ae5-c4cd-4afe-b084-bcc2da73e671 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-b039e43d-61e6-43ab-a3f3-7dacb31da48e-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Flow 'volume_create_manager' (89d902e2-8106-4225-9073-4c2e885ce438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12708481-f565-4489-829b-b61ef359d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12708481-f565-4489-829b-b61ef359d92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1473278475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7697065-6d34-43e0-b5ff-3a7bd270d4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6645fdb99f904123acd5e59346128b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:00Z,use_quota=True,user_id='d821f36eb6a7434893a45c844ff082ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcea92-a3ef-407a-8b5a-88581048ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcea92-a3ef-407a-8b5a-88581048ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d6f3d-8aba-4c7d-91f5-6354ba4a9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d6f3d-8aba-4c7d-91f5-6354ba4a9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7697065-6d34-43e0-b5ff-3a7bd270d4cd', 'volume_name': 'volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a75072-a013-4008-b70c-0d39b221e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a75072-a013-4008-b70c-0d39b221e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb4ee4d-8a97-4609-9d31-716b7d5273c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:59:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Volume b7697065-6d34-43e0-b5ff-3a7bd270d4cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd', 'volume_size': 1} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1473278475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7697065-6d34-43e0-b5ff-3a7bd270d4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6645fdb99f904123acd5e59346128b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:00Z,use_quota=True,user_id='d821f36eb6a7434893a45c844ff082ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Creating volume b7697065-6d34-43e0-b5ff-3a7bd270d4cd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:59:59 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 17:59:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:59:59 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd 1073741824 Sep 25 17:59:59 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:00 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd 1073741824" returned: 0 in 0.458s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:00 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd Sep 25 18:00:00 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:00 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb4ee4d-8a97-4609-9d31-716b7d5273c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deb8bd6-d2da-427d-bf84-25f2b38e5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Volume volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd (b7697065-6d34-43e0-b5ff-3a7bd270d4cd): created successfully Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deb8bd6-d2da-427d-bf84-25f2b38e5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Flow 'volume_create_manager' (89d902e2-8106-4225-9073-4c2e885ce438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-734bb6a2-79a8-4334-8ca0-21f938a861b4 tempest-VolumesTransfersV355Test-336271722 None] Created volume successfully. Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Acquiring lock "cinder-b7697065-6d34-43e0-b5ff-3a7bd270d4cd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-b7697065-6d34-43e0-b5ff-3a7bd270d4cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Acquiring lock "cinder-quobyte-b7697065-6d34-43e0-b5ff-3a7bd270d4cd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-quobyte-b7697065-6d34-43e0-b5ff-3a7bd270d4cd" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1ac77d-8d8d-4ee6-89bd-b121b8e58a65]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:01 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd Sep 25 18:00:01 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Flow 'volume_create_manager' (0b08b534-b738-4bc6-b659-5af86c83148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da11c7d-2574-4fec-b162-3338731ec248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da11c7d-2574-4fec-b162-3338731ec248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1979020928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab127ad-9939-4f54-80e0-598a727c23bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84f71e03b4eebbfab880634d6aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:02Z,use_quota=True,user_id='87bbd3c7559448c5938cfe4d93038adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e685f135-89c9-4152-a5e9-ee2885e5a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e685f135-89c9-4152-a5e9-ee2885e5a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc61e5e-dc25-43ab-b4b0-d8e36fb60c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc61e5e-dc25-43ab-b4b0-d8e36fb60c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab127ad-9939-4f54-80e0-598a727c23bb', 'volume_name': 'volume-1ab127ad-9939-4f54-80e0-598a727c23bb', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15947597-27e2-4e19-bb90-92e588741862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15947597-27e2-4e19-bb90-92e588741862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d6e087-cade-4a2e-8481-d32e72837a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Volume 1ab127ad-9939-4f54-80e0-598a727c23bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab127ad-9939-4f54-80e0-598a727c23bb', 'volume_size': 1} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1979020928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab127ad-9939-4f54-80e0-598a727c23bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84f71e03b4eebbfab880634d6aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:02Z,use_quota=True,user_id='87bbd3c7559448c5938cfe4d93038adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Creating volume 1ab127ad-9939-4f54-80e0-598a727c23bb {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:00:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:01 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb 1073741824 Sep 25 18:00:01 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:01 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd" returned: 0 in 0.440s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:01 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd Sep 25 18:00:01 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:02 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7697065-6d34-43e0-b5ff-3a7bd270d4cd" returned: 0 in 0.270s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-quobyte-b7697065-6d34-43e0-b5ff-3a7bd270d4cd" released by "delete_volume" :: held 0.771s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Created reservations ['9a99afd3-d9a9-4c1e-9e27-e372923d35ff', '95e836f4-8420-4748-92cd-0a3692c93671', 'f5590d78-9485-4031-acd8-860612d72cee', 'a52654ce-2fd2-495c-b0a6-0237ed0a89d2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:02 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:00:02 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:02 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb 1073741824" returned: 0 in 0.557s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:02 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb Sep 25 18:00:02 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:02 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.311s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:00:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Deleted volume successfully. Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-340cc421-a202-4cb0-a2b1-97e3a7913489 tempest-VolumesTransfersV355Test-1492291243 None] Lock "cinder-b7697065-6d34-43e0-b5ff-3a7bd270d4cd-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:02 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d6e087-cade-4a2e-8481-d32e72837a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab127ad-9939-4f54-80e0-598a727c23bb', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7641014d-e164-4a3d-a3fa-e00e5267c853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Volume volume-1ab127ad-9939-4f54-80e0-598a727c23bb (1ab127ad-9939-4f54-80e0-598a727c23bb): created successfully Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7641014d-e164-4a3d-a3fa-e00e5267c853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Flow 'volume_create_manager' (0b08b534-b738-4bc6-b659-5af86c83148b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e7a9649f-9125-48d9-b0e7-19cf4653615b tempest-AttachVolumeNegativeTest-460397942 None] Created volume successfully. Sep 25 18:00:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-79fecba4-e3d7-461a-851c-63e4128d014b req-8ad47a2f-7aef-4b41-8009-d28e258bfea4 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-79fecba4-e3d7-461a-851c-63e4128d014b req-8ad47a2f-7aef-4b41-8009-d28e258bfea4 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-79fecba4-e3d7-461a-851c-63e4128d014b req-8ad47a2f-7aef-4b41-8009-d28e258bfea4 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-79fecba4-e3d7-461a-851c-63e4128d014b req-8ad47a2f-7aef-4b41-8009-d28e258bfea4 tempest-AttachVolumeNegativeTest-460397942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-1ab127ad-9939-4f54-80e0-598a727c23bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22a81e02-ad9a-4bce-a98c-73005d68222f', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:00:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-79fecba4-e3d7-461a-851c-63e4128d014b req-8ad47a2f-7aef-4b41-8009-d28e258bfea4 tempest-AttachVolumeNegativeTest-460397942 None] attachment_update completed successfully. Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Flow 'volume_create_manager' (f9978ca3-d4f0-433a-8a73-6faae5b93ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1e504a-e531-43c4-a3ad-742c1995556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1e504a-e531-43c4-a3ad-742c1995556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-746439787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c002a-4c76-477d-abd3-28b44d1fc267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d8826d85d848bbbfd9d38ca45285bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:07Z,use_quota=True,user_id='7c4d7415b1a64999af820ea0907cf79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faca7cc0-2746-468e-8a6c-67364604fae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faca7cc0-2746-468e-8a6c-67364604fae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7314f413-bc69-44ad-98a7-04ccbd497c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7314f413-bc69-44ad-98a7-04ccbd497c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775c002a-4c76-477d-abd3-28b44d1fc267', 'volume_name': 'volume-775c002a-4c76-477d-abd3-28b44d1fc267', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f048d927-dede-4cd8-b3d4-24842b3b4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f048d927-dede-4cd8-b3d4-24842b3b4a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d60133-e4c9-4060-ade1-0d142ddad418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Volume 775c002a-4c76-477d-abd3-28b44d1fc267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775c002a-4c76-477d-abd3-28b44d1fc267', 'volume_size': 1} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-746439787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c002a-4c76-477d-abd3-28b44d1fc267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d8826d85d848bbbfd9d38ca45285bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:07Z,use_quota=True,user_id='7c4d7415b1a64999af820ea0907cf79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Creating volume 775c002a-4c76-477d-abd3-28b44d1fc267 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:00:07 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:07 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 1073741824 Sep 25 18:00:07 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:07 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 1073741824" returned: 0 in 0.639s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:07 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 Sep 25 18:00:07 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:08 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267" returned: 0 in 0.370s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d60133-e4c9-4060-ade1-0d142ddad418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775c002a-4c76-477d-abd3-28b44d1fc267', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b9baf2-c33d-4374-8fe8-caa433f783b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Volume volume-775c002a-4c76-477d-abd3-28b44d1fc267 (775c002a-4c76-477d-abd3-28b44d1fc267): created successfully Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b9baf2-c33d-4374-8fe8-caa433f783b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Flow 'volume_create_manager' (f9978ca3-d4f0-433a-8a73-6faae5b93ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5abd8bec-8a69-43f7-ae45-46d95800e380 tempest-AttachVolumeTestJSON-1324949849 None] Created volume successfully. Sep 25 18:00:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-5f15dfaf-6763-4ab7-89bc-f2d4f541d314 req-65dfab43-5476-4615-b2e5-735840185db3 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-5f15dfaf-6763-4ab7-89bc-f2d4f541d314 req-65dfab43-5476-4615-b2e5-735840185db3 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-5f15dfaf-6763-4ab7-89bc-f2d4f541d314 req-65dfab43-5476-4615-b2e5-735840185db3 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-5f15dfaf-6763-4ab7-89bc-f2d4f541d314 req-65dfab43-5476-4615-b2e5-735840185db3 tempest-AttachVolumeTestJSON-1324949849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-775c002a-4c76-477d-abd3-28b44d1fc267', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56e68e84-0401-453c-aeaa-00250fc4af3d', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:00:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-5f15dfaf-6763-4ab7-89bc-f2d4f541d314 req-65dfab43-5476-4615-b2e5-735840185db3 tempest-AttachVolumeTestJSON-1324949849 None] attachment_update completed successfully. Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Flow 'volume_create_manager' (e0abcac9-b43c-4d64-9cf2-e8160b60412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566bc862-b172-4f25-b93d-0475338dec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566bc862-b172-4f25-b93d-0475338dec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1874195489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc7c523-0509-49af-81de-8f7ea7bd3a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19849529c5cb406883fbbb238d9b4ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:12Z,use_quota=True,user_id='49a2192aa05b41348780c6025a67fdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613aed60-1e60-4d7b-b042-570318aab557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613aed60-1e60-4d7b-b042-570318aab557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86559478-736c-4f1f-bfba-8d31340cb1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86559478-736c-4f1f-bfba-8d31340cb1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc7c523-0509-49af-81de-8f7ea7bd3a5c', 'volume_name': 'volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbda9dc4-d5b6-40ec-9673-5a6d9e3bfb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbda9dc4-d5b6-40ec-9673-5a6d9e3bfb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b88cdeb-0786-4e7b-9312-2ccd16f766b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:11 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Volume 4cc7c523-0509-49af-81de-8f7ea7bd3a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c', 'volume_size': 1} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1874195489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc7c523-0509-49af-81de-8f7ea7bd3a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19849529c5cb406883fbbb238d9b4ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:12Z,use_quota=True,user_id='49a2192aa05b41348780c6025a67fdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Creating volume 4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:00:11 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:00:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:11 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c 1073741824 Sep 25 18:00:11 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:12 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c 1073741824" returned: 0 in 0.736s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:12 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:00:12 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:12 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b88cdeb-0786-4e7b-9312-2ccd16f766b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c933ae-1218-4b9e-9c82-6050fdc68703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Volume volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c (4cc7c523-0509-49af-81de-8f7ea7bd3a5c): created successfully Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c933ae-1218-4b9e-9c82-6050fdc68703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Flow 'volume_create_manager' (e0abcac9-b43c-4d64-9cf2-e8160b60412c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-154850e9-fc3c-4a93-bbe5-9cba5f8ec691 tempest-VolumesActionsTest-402767989 None] Created volume successfully. Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Flow 'volume_create_manager' (b3018646-7e0c-46ee-ba98-a5851e54535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71ee1e6-f039-4a73-98bc-a96e1aeeef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71ee1e6-f039-4a73-98bc-a96e1aeeef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-244283423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a324edd9-5a03-479f-9d7b-fec8ff00fd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf2e461e8374130aa91c9381fc29a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:17Z,use_quota=True,user_id='19a779c24ce844ea9eebb1fe5de3b14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9beffa-9740-4fa1-a1d6-d21ef065cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9beffa-9740-4fa1-a1d6-d21ef065cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1705a4c4-2d46-46c1-8ab9-03a3d185f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:16 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:00:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1705a4c4-2d46-46c1-8ab9-03a3d185f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a324edd9-5a03-479f-9d7b-fec8ff00fd74', 'volume_name': 'volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2109ca-c334-45fb-a455-f4534cca89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2109ca-c334-45fb-a455-f4534cca89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f620939-5859-4556-90e2-5cda84ea1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:17 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Volume a324edd9-5a03-479f-9d7b-fec8ff00fd74: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 18:00:17 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Trying to clone a324edd9-5a03-479f-9d7b-fec8ff00fd74 from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:00:18 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:00:18 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Image download 20.69 MB at 20.69 MB/s Sep 25 18:00:18 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[57478b2d-ecc3-4781-985c-7c3628e1a4fa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:18 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD Sep 25 18:00:18 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:18 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:18 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 is fetched for user 19a779c24ce844ea9eebb1fe5de3b14f. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[71152423-bc55-44cf-81c4-5a075f5a4ba6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:19 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD Sep 25 18:00:19 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:19 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-244283423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a324edd9-5a03-479f-9d7b-fec8ff00fd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf2e461e8374130aa91c9381fc29a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:17Z,use_quota=True,user_id='19a779c24ce844ea9eebb1fe5de3b14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Creating volume a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:00:19 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:00:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:19 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 1073741824 Sep 25 18:00:19 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:20 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 1073741824" returned: 0 in 0.775s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:20 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 Sep 25 18:00:20 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:20 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Attempting download of cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume a324edd9-5a03-479f-9d7b-fec8ff00fd74. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f695c2-d73c-45e5-9d6f-ac5f2a841d3c]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:21 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn Sep 25 18:00:21 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:21 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn" returned: 0 in 0.517s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:21 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn Sep 25 18:00:21 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:22 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn" returned: 1 in 0.932s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_v4k91mfn' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:00:22 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1388410-ad27-483f-b998-0356ab781084]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:22 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD Sep 25 18:00:22 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:23 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:23 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 was qcow2, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:00:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:23 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 Sep 25 18:00:23 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:28 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74" returned: 0 in 5.089s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_brmc26jxdevstack@QuobyteHD, size 112.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:00:28 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Converted 112.00 MB image at 21.99 MB/s Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:28 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 1G Sep 25 18:00:28 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:28 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 1G" returned: 0 in 0.632s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Downloaded image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume a324edd9-5a03-479f-9d7b-fec8ff00fd74 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 for user 19a779c24ce844ea9eebb1fe5de3b14f is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Marking volume a324edd9-5a03-479f-9d7b-fec8ff00fd74 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=69,cinder:UPDATE=72,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Copying metadata from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 to a324edd9-5a03-479f-9d7b-fec8ff00fd74. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Creating volume glance metadata for volume a324edd9-5a03-479f-9d7b-fec8ff00fd74 backed by image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:00:28 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=66,cinder:UPDATE=83,cinder:INSERT=17,cinder:DELETE=11 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f620939-5859-4556-90e2-5cda84ea1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b8ffe7-c83e-41cf-a080-27de6fbf9a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Volume volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 (a324edd9-5a03-479f-9d7b-fec8ff00fd74): created successfully Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b8ffe7-c83e-41cf-a080-27de6fbf9a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Flow 'volume_create_manager' (b3018646-7e0c-46ee-ba98-a5851e54535c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-889730cf-0fa0-4743-a3bd-af1d88ec2cfc tempest-VolumesExtendTest-1871463282 None] Created volume successfully. Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee840d0-7ebc-4926-a057-7a62e8fe61e3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:30 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 Sep 25 18:00:30 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:30 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74" returned: 0 in 0.691s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 2G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb367bbc-32ac-4412-8fe1-f1404af4adfc tempest-VolumesActionsTest-402767989 None] Acquiring lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" by "attach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 2G" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.028s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb367bbc-32ac-4412-8fe1-f1404af4adfc tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" acquired by "attach_volume" :: waited 0.067s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1db3dc23-44b8-4d13-9021-192e05c856fb tempest-VolumesExtendTest-1871463282 None] Extend volume completed successfully. Sep 25 18:00:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cb367bbc-32ac-4412-8fe1-f1404af4adfc tempest-VolumesActionsTest-402767989 None] Attaching volume 4cc7c523-0509-49af-81de-8f7ea7bd3a5c to instance a703a12a-2dc0-4726-9f41-5af13943cca9 at mountpoint /dev/vdb on host None. Sep 25 18:00:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cb367bbc-32ac-4412-8fe1-f1404af4adfc tempest-VolumesActionsTest-402767989 None] Attach volume completed successfully. Sep 25 18:00:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cb367bbc-32ac-4412-8fe1-f1404af4adfc tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" released by "attach_volume" :: held 0.184s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0971e95a-060a-4566-b2d8-1ebc29e02446 tempest-VolumesActionsTest-402767989 None] Acquiring lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-detach_volume" by "detach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0971e95a-060a-4566-b2d8-1ebc29e02446 tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0971e95a-060a-4566-b2d8-1ebc29e02446 tempest-VolumesActionsTest-402767989 None] Detaching volume 4cc7c523-0509-49af-81de-8f7ea7bd3a5c from instance a703a12a-2dc0-4726-9f41-5af13943cca9. Sep 25 18:00:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0971e95a-060a-4566-b2d8-1ebc29e02446 tempest-VolumesActionsTest-402767989 None] Detach volume completed successfully. Sep 25 18:00:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0971e95a-060a-4566-b2d8-1ebc29e02446 tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-a324edd9-5a03-479f-9d7b-fec8ff00fd74-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Lock "cinder-a324edd9-5a03-479f-9d7b-fec8ff00fd74-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-quobyte-a324edd9-5a03-479f-9d7b-fec8ff00fd74" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-a324edd9-5a03-479f-9d7b-fec8ff00fd74" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f63e2-1689-4408-a583-f4d2623de03e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:33 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 Sep 25 18:00:33 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:33 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74" returned: 0 in 0.620s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:33 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74 Sep 25 18:00:33 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:34 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a324edd9-5a03-479f-9d7b-fec8ff00fd74" returned: 0 in 0.524s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-a324edd9-5a03-479f-9d7b-fec8ff00fd74" released by "delete_volume" :: held 1.229s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Created reservations ['bf5ddbc4-3b01-4fa0-8fc5-7cce7fb0a67d', '680e38a7-aabd-4d54-a3d7-e49ce1beec33', 'fcd0d494-3ca4-4b0c-8c86-0d5964d3b2aa', '20ea05ea-97e3-4b40-aa30-0596ac8d1d98'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:34 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:00:34 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:35 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.525s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:35 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:00:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Deleted volume successfully. Sep 25 18:00:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-71d9679f-c864-4130-9c68-f5e505a4216d tempest-VolumesExtendTest-1871463282 None] Lock "cinder-a324edd9-5a03-479f-9d7b-fec8ff00fd74-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Flow 'volume_create_manager' (afb5c02f-4970-437d-9045-18acf41ef994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac30ba03-44cd-4aa5-9136-2ff77b7b55d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac30ba03-44cd-4aa5-9136-2ff77b7b55d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1188548817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b32bc0-f714-462d-8b8f-fcebf8dee4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf2e461e8374130aa91c9381fc29a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:36Z,use_quota=True,user_id='19a779c24ce844ea9eebb1fe5de3b14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2966d13-b0c2-4944-827f-b3907b16b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2966d13-b0c2-4944-827f-b3907b16b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb51f07-e311-40e0-a352-1555200a71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb51f07-e311-40e0-a352-1555200a71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b32bc0-f714-462d-8b8f-fcebf8dee4da', 'volume_name': 'volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6021af19-14c9-4e3e-994e-afd294117b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6021af19-14c9-4e3e-994e-afd294117b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00af8587-2da1-43c0-abf0-f7d475800cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:36 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Volume f7b32bc0-f714-462d-8b8f-fcebf8dee4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da', 'volume_size': 1} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1188548817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b32bc0-f714-462d-8b8f-fcebf8dee4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf2e461e8374130aa91c9381fc29a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:36Z,use_quota=True,user_id='19a779c24ce844ea9eebb1fe5de3b14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Creating volume f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:00:36 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:36 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da 1073741824 Sep 25 18:00:36 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:36 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da 1073741824" returned: 0 in 0.538s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:37 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da Sep 25 18:00:37 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:37 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" returned: 0 in 0.277s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00af8587-2da1-43c0-abf0-f7d475800cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a558be-1ac5-4194-bc30-8a6559cc891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:37 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Volume volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da (f7b32bc0-f714-462d-8b8f-fcebf8dee4da): created successfully Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a558be-1ac5-4194-bc30-8a6559cc891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Flow 'volume_create_manager' (afb5c02f-4970-437d-9045-18acf41ef994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1353f71e-5e37-41f1-a8f9-9090b836a76f tempest-VolumesExtendTest-1871463282 None] Created volume successfully. Sep 25 18:00:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Creating offline snapshot 41a5b500-9f2c-4507-9c0c-f3a172000e85 of volume f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:00:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba00ecb3-de01-4ee4-ac92-3228fb1453c0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:39 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da Sep 25 18:00:39 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:39 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" returned: 0 in 0.650s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:39 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 1G Sep 25 18:00:39 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:40 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 1G" returned: 0 in 0.642s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:40 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 Sep 25 18:00:40 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:40 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85" returned: 0 in 0.399s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:40 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 is being set with open permissions: ugo+rw Sep 25 18:00:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:40 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 Sep 25 18:00:40 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:40 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85" returned: 0 in 0.339s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:40 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info Sep 25 18:00:40 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:41 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info" returned: 0 in 0.343s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:41 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info is being set with open permissions: ugo+rw Sep 25 18:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:41 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info Sep 25 18:00:41 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:41 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.info" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c58fd2f5-1172-4b4f-9b09-77dfca73429d tempest-VolumesExtendTest-1871463282 None] Create snapshot completed successfully Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f0716e-a1d4-4031-b592-0f9b0f994dfa]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:42 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da Sep 25 18:00:42 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:42 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" returned: 0 in 0.419s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 2G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 2G" returned: 0 in 0.158s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.630s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:42 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-61e3f288-e454-4e22-9ca6-22c3488561d5 tempest-VolumesExtendTest-1871463282 None] Extend volume completed successfully. Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-41a5b500-9f2c-4507-9c0c-f3a172000e85-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-41a5b500-9f2c-4507-9c0c-f3a172000e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-quobyte-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-quobyte-41a5b500-9f2c-4507-9c0c-f3a172000e85" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-41a5b500-9f2c-4507-9c0c-f3a172000e85" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Deleting offline snapshot 41a5b500-9f2c-4507-9c0c-f3a172000e85 of volume f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] snapshot_file for this snap is: volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd065f-5e2a-4922-be3f-7a9bd4bb1f1a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:43 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 Sep 25 18:00:43 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:44 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85" returned: 0 in 0.593s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:00:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970bf91-e01e-4f7c-8958-053e3967265b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:44 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da Sep 25 18:00:44 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:44 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" returned: 0 in 0.437s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:44 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 Sep 25 18:00:44 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:45 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85" returned: 0 in 0.515s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:45 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85 Sep 25 18:00:45 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:45 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da.41a5b500-9f2c-4507-9c0c-f3a172000e85" returned: 0 in 0.302s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-41a5b500-9f2c-4507-9c0c-f3a172000e85" released by "_delete_snapshot" :: held 2.074s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" released by "delete_snapshot" :: held 2.108s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Created reservations ['5fcb803f-30ca-4c0e-87d4-4960970cde4a', 'da22b052-e8e8-4f85-9d1f-97d084a51a24', '954dac78-e7c4-4d06-aab0-f528d6a2a08e', '9f5474c5-748c-4a5d-9bc9-eaf25e419d81'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:00:45 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Delete snapshot completed successfully. Sep 25 18:00:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9c2e6bbb-446f-408b-b51b-d21a70fc7c52 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-41a5b500-9f2c-4507-9c0c-f3a172000e85-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e81b47c4-cf87-4f7b-aab4-1b8f0f22a8a7 tempest-VolumesActionsTest-402767989 None] Acquiring lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" by "attach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e81b47c4-cf87-4f7b-aab4-1b8f0f22a8a7 tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" acquired by "attach_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e81b47c4-cf87-4f7b-aab4-1b8f0f22a8a7 tempest-VolumesActionsTest-402767989 None] Attaching volume 4cc7c523-0509-49af-81de-8f7ea7bd3a5c to instance 2f0cb076-826f-41a9-8c79-ec66f01c531f at mountpoint /dev/vdb on host None. Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-f7b32bc0-f714-462d-8b8f-fcebf8dee4da-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e81b47c4-cf87-4f7b-aab4-1b8f0f22a8a7 tempest-VolumesActionsTest-402767989 None] Attach volume completed successfully. Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e81b47c4-cf87-4f7b-aab4-1b8f0f22a8a7 tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" released by "attach_volume" :: held 0.144s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-f7b32bc0-f714-462d-8b8f-fcebf8dee4da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "cinder-quobyte-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f5075c-9ec3-463f-8e40-68c1db36a6a1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:47 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da Sep 25 18:00:47 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ad51151-5b5b-482f-9a51-41b3739492d9 tempest-VolumesActionsTest-402767989 None] Acquiring lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-detach_volume" by "detach_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ad51151-5b5b-482f-9a51-41b3739492d9 tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:00:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6ad51151-5b5b-482f-9a51-41b3739492d9 tempest-VolumesActionsTest-402767989 None] Detaching volume 4cc7c523-0509-49af-81de-8f7ea7bd3a5c from instance 2f0cb076-826f-41a9-8c79-ec66f01c531f. Sep 25 18:00:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6ad51151-5b5b-482f-9a51-41b3739492d9 tempest-VolumesActionsTest-402767989 None] Detach volume completed successfully. Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ad51151-5b5b-482f-9a51-41b3739492d9 tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:47 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" returned: 0 in 0.553s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:47 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da Sep 25 18:00:47 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:47 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" returned: 0 in 0.367s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-quobyte-f7b32bc0-f714-462d-8b8f-fcebf8dee4da" released by "delete_volume" :: held 1.036s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Created reservations ['57276299-1ede-43c9-b3c9-1bebefb8062e', 'bbdb72e4-6a8b-4bb1-9bd1-d2680cb7616e', '59f4d650-c22d-425a-9efd-703afd63f8e5', '378bb790-80a2-48b5-8dc5-a73df512979d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:48 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:00:48 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:48 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.422s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:00:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Deleted volume successfully. Sep 25 18:00:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6ee2adbc-7649-4ebf-a37d-eb5b91bf2553 tempest-VolumesExtendTest-1871463282 None] Lock "cinder-f7b32bc0-f714-462d-8b8f-fcebf8dee4da-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:00:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:52 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d4918-e7cf-428e-8977-75d569bc66f5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:53 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:00:53 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:53 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.504s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1642631c-4e53-4ae1-bc0c-5271b971b65f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Flow 'volume_create_manager' (9c22a1d5-8ffb-441f-ae32-8e35b37d0864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:00:53 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:00:53 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2884fdf5-5971-4d27-a62f-ace99a4ac7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2884fdf5-5971-4d27-a62f-ace99a4ac7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-545702263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0258c4bffe36425aa5a0e6558de32a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:53Z,use_quota=True,user_id='88cd00e181e54acbbb0cfa13e16cc658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5b1215-d733-4e7f-80bc-85d51f022c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5b1215-d733-4e7f-80bc-85d51f022c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adec9cc-9e01-46f6-a2a7-1c0d5aa2e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adec9cc-9e01-46f6-a2a7-1c0d5aa2e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e', 'volume_name': 'volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d97788b-7c81-407f-a57e-b74369c65455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d97788b-7c81-407f-a57e-b74369c65455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda6aedf-04c6-43e0-b0c7-f85188038b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:00:53 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Volume a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e', 'volume_size': 1} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:53 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.410s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.618109ce-6f49-4a77-9fb3-56553d991a5cbn6hiwlj.img {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:53 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.618109ce-6f49-4a77-9fb3-56553d991a5cbn6hiwlj.img Sep 25 18:00:53 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:00:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:00:55 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:00:55 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:00:56 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 25 18:00:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.591s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:00:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:00:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:00:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:00:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:00:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-ca709759-78b9-471c-8923-60d675e4f976 req-bc46d132-3548-4548-887b-277b763479f8 tempest-AttachVolumeNegativeTest-460397942 None] Terminate volume connection completed successfully. Sep 25 18:00:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-ca709759-78b9-471c-8923-60d675e4f976 req-bc46d132-3548-4548-887b-277b763479f8 tempest-AttachVolumeNegativeTest-460397942 None] Deleting attachment 22a81e02-ad9a-4bce-a98c-73005d68222f. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:01:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-8da4c06e-5e58-4da2-ac2b-72196580f296 req-2423cccd-c7a6-4e11-afd1-ef723b9a33e0 tempest-AttachVolumeTestJSON-1324949849 None] Terminate volume connection completed successfully. Sep 25 18:01:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-8da4c06e-5e58-4da2-ac2b-72196580f296 req-2423cccd-c7a6-4e11-afd1-ef723b9a33e0 tempest-AttachVolumeTestJSON-1324949849 None] Deleting attachment 56e68e84-0401-453c-aeaa-00250fc4af3d. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:01:02 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.618109ce-6f49-4a77-9fb3-56553d991a5cbn6hiwlj.img" returned: 0 in 8.234s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c3adc-b1f2-4f51-972b-fac4de3a9cf5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:02 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:01:02 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:02 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.635s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:02 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.618109ce-6f49-4a77-9fb3-56553d991a5cbn6hiwlj.img {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:01:02 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Converted 1024.00 MB image at 124.32 MB/s Sep 25 18:01:02 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] 618109ce-6f49-4a77-9fb3-56553d991a5c was raw, no need to convert to raw {{(pid=86665) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 18:01:12 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=45,cinder:INSERT=12,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:01:12 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=50,cinder:INSERT=18,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.336s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Uploaded volume to glance image-id: 618109ce-6f49-4a77-9fb3-56553d991a5c. {{(pid=86665) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.578s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-545702263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0258c4bffe36425aa5a0e6558de32a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:00:53Z,use_quota=True,user_id='88cd00e181e54acbbb0cfa13e16cc658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Creating volume a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:01:29 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:29 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e 1073741824 Sep 25 18:01:29 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-97df13e4-f1b1-4590-90a0-546581466775 tempest-VolumesActionsTest-402767989 None] Copy volume to image completed successfully. Sep 25 18:01:29 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e 1073741824" returned: 0 in 0.491s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:29 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e Sep 25 18:01:29 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:30 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e" returned: 0 in 0.429s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda6aedf-04c6-43e0-b0c7-f85188038b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f7d7e1-cd19-4af6-a26d-35cdbef88bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Volume volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e (a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e): created successfully Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f7d7e1-cd19-4af6-a26d-35cdbef88bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Flow 'volume_create_manager' (9c22a1d5-8ffb-441f-ae32-8e35b37d0864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-795c2319-8958-4309-83fe-a76e3d58780f tempest-VolumesListTestJSON-1278447702 None] Created volume successfully. Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Flow 'volume_create_manager' (d0d6e013-a007-4bc8-82f0-9e9d7fc347f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c362a9-7e6d-481c-b676-a7bbc5849a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c362a9-7e6d-481c-b676-a7bbc5849a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1806485125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2c1a3b-5955-4618-b19a-bfa4c7e524cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0258c4bffe36425aa5a0e6558de32a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:01:31Z,use_quota=True,user_id='88cd00e181e54acbbb0cfa13e16cc658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c97ed6-f5d1-4fd8-93f5-0db59023fef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c97ed6-f5d1-4fd8-93f5-0db59023fef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdd263e-8887-4dad-b137-d7d9faebb7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdd263e-8887-4dad-b137-d7d9faebb7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2c1a3b-5955-4618-b19a-bfa4c7e524cd', 'volume_name': 'volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a4033f-9559-423f-8486-9161e778afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a4033f-9559-423f-8486-9161e778afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15c5178-8e54-4302-99f0-41e1eef8b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:31 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Volume ef2c1a3b-5955-4618-b19a-bfa4c7e524cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd', 'volume_size': 1} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1806485125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2c1a3b-5955-4618-b19a-bfa4c7e524cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0258c4bffe36425aa5a0e6558de32a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:01:31Z,use_quota=True,user_id='88cd00e181e54acbbb0cfa13e16cc658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Creating volume ef2c1a3b-5955-4618-b19a-bfa4c7e524cd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:01:31 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:31 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd 1073741824 Sep 25 18:01:31 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:32 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd 1073741824" returned: 0 in 0.635s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:32 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd Sep 25 18:01:32 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:32 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd" returned: 0 in 0.380s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.039s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15c5178-8e54-4302-99f0-41e1eef8b624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff8c182-e7b3-421f-93cd-5f9187762dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c8a9ec-34d6-4114-9bd0-5454f43e1122]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Volume volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd (ef2c1a3b-5955-4618-b19a-bfa4c7e524cd): created successfully Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff8c182-e7b3-421f-93cd-5f9187762dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Flow 'volume_create_manager' (d0d6e013-a007-4bc8-82f0-9e9d7fc347f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f4f8b1f6-29fa-4379-b3db-a7c37ece7713 tempest-VolumesListTestJSON-1278447702 None] Created volume successfully. Sep 25 18:01:32 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:01:32 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:33 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.458s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d335dc-1144-4f12-b9f3-85e1f6a0e535]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:33 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:01:33 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:33 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.422s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:33 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img Sep 25 18:01:33 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Flow 'volume_create_manager' (17fc3d5e-8c48-4589-8b86-1cc969f78b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25db3b4-1d6e-4f93-a76c-99a3e6f0ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25db3b4-1d6e-4f93-a76c-99a3e6f0ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827686484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c4dbc-54bc-4aac-8276-43417cfdcb0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0258c4bffe36425aa5a0e6558de32a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:01:35Z,use_quota=True,user_id='88cd00e181e54acbbb0cfa13e16cc658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ba3a4d-5038-4314-a406-92e675c0e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ba3a4d-5038-4314-a406-92e675c0e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7ea34c-ae93-4b8c-9f23-40fca27e00cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7ea34c-ae93-4b8c-9f23-40fca27e00cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0c4dbc-54bc-4aac-8276-43417cfdcb0f', 'volume_name': 'volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334d4e8e-b6d6-4105-9f26-b639a5c09227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334d4e8e-b6d6-4105-9f26-b639a5c09227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e089a8e4-13d6-4103-a092-24b4fef988fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Volume 7d0c4dbc-54bc-4aac-8276-43417cfdcb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f', 'volume_size': 1} Sep 25 18:01:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:41 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img" returned: 0 in 7.577s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7689cce-ad69-4575-8e85-77dc62da40b9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:41 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:01:41 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:41 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.581s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:01:41 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Converted 1024.00 MB image at 135.11 MB/s Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] 41090d93-25e0-4130-82d3-eeb690a41e9b was raw, converting to qcow2 {{(pid=86665) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c2005-9c0a-48c5-90ae-4ce32001f5fc]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:42 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img Sep 25 18:01:42 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:42 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img" returned: 0 in 0.462s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:42 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img Sep 25 18:01:42 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:42 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img" returned: 1 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:01:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:42 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt Sep 25 18:01:42 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:43 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Image conversion details: src /opt/stack/data/cinder/conversion/4cc7c523-0509-49af-81de-8f7ea7bd3a5c.temp_image.41090d93-25e0-4130-82d3-eeb690a41e9bszkgcdgm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:01:43 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1383c875-7a0e-4dd5-b4e3-07abef6d9cd7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:43 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt Sep 25 18:01:43 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Flow 'volume_create_manager' (998fff2c-6fc1-45aa-9218-88ab941a4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3444dfd7-efd9-48b7-9762-c9c37e89fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3444dfd7-efd9-48b7-9762-c9c37e89fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1846615227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ecc879-d1de-4f15-8cfd-6f4f773b9bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84f71e03b4eebbfab880634d6aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:01:43Z,use_quota=True,user_id='87bbd3c7559448c5938cfe4d93038adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:43 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2109af-693b-48a4-a4b1-a207bb434aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2109af-693b-48a4-a4b1-a207bb434aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c8bac0-ea56-4268-8557-91f840a7466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c8bac0-ea56-4268-8557-91f840a7466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ecc879-d1de-4f15-8cfd-6f4f773b9bdd', 'volume_name': 'volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f1a9ce-d3b4-4fd0-a0fc-f1dd0574528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f1a9ce-d3b4-4fd0-a0fc-f1dd0574528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e995068-b9a5-44d2-b0f1-3c5dc77a5a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:43 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Volume 21ecc879-d1de-4f15-8cfd-6f4f773b9bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd', 'volume_size': 1} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_i1glhcvt" returned: 0 in 0.563s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.320s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Uploaded volume to glance image-id: 41090d93-25e0-4130-82d3-eeb690a41e9b. {{(pid=86665) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.107s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827686484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c4dbc-54bc-4aac-8276-43417cfdcb0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0258c4bffe36425aa5a0e6558de32a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:01:35Z,use_quota=True,user_id='88cd00e181e54acbbb0cfa13e16cc658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Creating volume 7d0c4dbc-54bc-4aac-8276-43417cfdcb0f {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:01:45 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:01:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:45 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f 1073741824 Sep 25 18:01:45 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:45 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d9496110-fbfb-4225-8716-ad4085dd3f68 tempest-VolumesActionsTest-402767989 None] Copy volume to image completed successfully. Sep 25 18:01:46 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f 1073741824" returned: 0 in 0.909s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:46 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f Sep 25 18:01:46 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:46 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f" returned: 0 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.931s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1846615227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ecc879-d1de-4f15-8cfd-6f4f773b9bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84f71e03b4eebbfab880634d6aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:01:43Z,use_quota=True,user_id='87bbd3c7559448c5938cfe4d93038adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Creating volume 21ecc879-d1de-4f15-8cfd-6f4f773b9bdd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:01:46 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Acquiring lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e089a8e4-13d6-4103-a092-24b4fef988fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3575f6-afc6-4b0b-987c-ad981f5064cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:46 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd 1073741824 Sep 25 18:01:46 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:46 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Volume volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f (7d0c4dbc-54bc-4aac-8276-43417cfdcb0f): created successfully Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3575f6-afc6-4b0b-987c-ad981f5064cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Flow 'volume_create_manager' (17fc3d5e-8c48-4589-8b86-1cc969f78b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-333bd3c4-7f84-4eeb-9e37-79c0377af1dd tempest-VolumesListTestJSON-1278447702 None] Created volume successfully. Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Acquiring lock "cinder-quobyte-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Lock "cinder-quobyte-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[670072f4-a87c-4e1a-ba6a-64c064a62926]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:46 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:01:46 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:47 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd 1073741824" returned: 0 in 0.593s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:47 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd Sep 25 18:01:47 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:47 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.417s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:47 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c Sep 25 18:01:47 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:47 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e995068-b9a5-44d2-b0f1-3c5dc77a5a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9124a3-9a34-48cb-8f35-1d409a5e64ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:01:47 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Volume volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd (21ecc879-d1de-4f15-8cfd-6f4f773b9bdd): created successfully Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9124a3-9a34-48cb-8f35-1d409a5e64ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Flow 'volume_create_manager' (998fff2c-6fc1-45aa-9218-88ab941a4865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:01:47 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" returned: 0 in 0.276s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Lock "cinder-quobyte-4cc7c523-0509-49af-81de-8f7ea7bd3a5c" released by "delete_volume" :: held 0.753s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2d51536d-67ca-4d87-bd41-6c87f5da6ee8 tempest-AttachVolumeNegativeTest-460397942 None] Created volume successfully. Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Created reservations ['3a1f128b-ad2c-441d-9a7c-314e45233d81', 'dfed04fd-8566-4a55-96b1-923acadb5ccb', '4526f636-d662-42cc-ac3a-4085a62ad27e', '593bae83-a4d4-4abc-b408-02c94319d0e3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:47 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:01:47 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:48 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:01:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Deleted volume successfully. Sep 25 18:01:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f08e9109-8bf8-4ac3-a389-3b33696406ff tempest-VolumesActionsTest-402767989 None] Lock "cinder-4cc7c523-0509-49af-81de-8f7ea7bd3a5c-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-c2006ca9-dcb4-4e04-afe0-bc5bcf449955 req-2d99bfb9-71c3-4ea4-aaea-d349ef5faa93 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-c2006ca9-dcb4-4e04-afe0-bc5bcf449955 req-2d99bfb9-71c3-4ea4-aaea-d349ef5faa93 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-c2006ca9-dcb4-4e04-afe0-bc5bcf449955 req-2d99bfb9-71c3-4ea4-aaea-d349ef5faa93 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-c2006ca9-dcb4-4e04-afe0-bc5bcf449955 req-2d99bfb9-71c3-4ea4-aaea-d349ef5faa93 tempest-AttachVolumeNegativeTest-460397942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83930fd5-f9f2-4583-9496-4e88b4ae854a', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:01:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-c2006ca9-dcb4-4e04-afe0-bc5bcf449955 req-2d99bfb9-71c3-4ea4-aaea-d349ef5faa93 tempest-AttachVolumeNegativeTest-460397942 None] attachment_update completed successfully. Sep 25 18:01:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "cinder-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "cinder-quobyte-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-quobyte-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ac87a-b315-4bb2-a33d-cfce0a48f24b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:51 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f Sep 25 18:01:51 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:52 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f" returned: 0 in 0.681s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:52 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f Sep 25 18:01:52 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:52 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-quobyte-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f" released by "delete_volume" :: held 1.106s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Created reservations ['d24b6f8e-7518-410e-bb30-a2be73c6e211', '7328738e-f0e8-49dd-8183-7507adca74d2', '70710f1f-e3e4-4a1c-82d5-a7322a12521f', '5aaa5413-2cc8-4952-a007-969535aa67ca'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:53 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:01:53 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:53 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.397s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:01:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Deleted volume successfully. Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-546c599f-61c8-45f5-a801-54d4733e9814 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-7d0c4dbc-54bc-4aac-8276-43417cfdcb0f-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-4b932b33-c5a8-472c-9a6c-619bc4b5fca6 req-3a7341be-485b-4c2c-8c9c-d4f98a28b219 tempest-AttachVolumeNegativeTest-460397942 None] Terminate volume connection completed successfully. Sep 25 18:01:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-4b932b33-c5a8-472c-9a6c-619bc4b5fca6 req-3a7341be-485b-4c2c-8c9c-d4f98a28b219 tempest-AttachVolumeNegativeTest-460397942 None] Deleting attachment 83930fd5-f9f2-4583-9496-4e88b4ae854a. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "cinder-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "cinder-quobyte-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-quobyte-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1738cc0-e1c5-4802-a1c2-5cf05177e4ee]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:54 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd Sep 25 18:01:54 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:54 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd" returned: 0 in 0.655s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:54 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd Sep 25 18:01:54 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:55 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd" returned: 0 in 0.589s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-quobyte-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd" released by "delete_volume" :: held 1.325s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Created reservations ['aafabdb8-5fe1-4c5c-b3f7-300997132ba1', 'a0b76beb-4f53-4090-b9d1-03c971e97f13', 'fba779fa-9f62-477f-a25f-7475f5a752ea', '0f8c874d-ddfa-463d-8691-70c0925dc6cf'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:55 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:01:55 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:56 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:01:56 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:56 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.543s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:01:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Deleted volume successfully. Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-505d8a9e-b57e-4cd7-a51e-509128a30527 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-ef2c1a3b-5955-4618-b19a-bfa4c7e524cd-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:56 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.561s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "cinder-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "cinder-quobyte-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-quobyte-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb814d-dc90-4574-9621-bad0a573d041]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:01:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:57 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e Sep 25 18:01:57 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:57 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e" returned: 0 in 0.621s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:57 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e Sep 25 18:01:57 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:57 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-quobyte-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e" released by "delete_volume" :: held 1.077s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:01:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Created reservations ['a7273dbc-7f59-4c41-915d-9ec566e6fd5a', '4a515c6d-b59b-49a7-aea8-4087581a52d6', 'fb65b384-21f5-448c-94c7-09333745d284', '4e3f6d4f-4901-4429-9172-6c2593438248'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:01:58 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:01:58 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:01:58 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:01:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Deleted volume successfully. Sep 25 18:01:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-08cf0d16-d0e1-4f50-9c20-9df833dd6af3 tempest-VolumesListTestJSON-1278447702 None] Lock "cinder-a6a84f5f-cab5-44d1-b20b-dc1a71a7d19e-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (73925f7b-8399-4f67-8dcd-b2da7e49aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7040c9-6dbc-43eb-8b2e-d8bf681c61e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7040c9-6dbc-43eb-8b2e-d8bf681c61e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-257617693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d28e86f-8475-4629-8374-ead33b54cc59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:01Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30922805-0c8a-4fe1-b439-2fa598fff3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30922805-0c8a-4fe1-b439-2fa598fff3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e39792-3646-4609-a354-fca6db3e00f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e39792-3646-4609-a354-fca6db3e00f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d28e86f-8475-4629-8374-ead33b54cc59', 'volume_name': 'volume-9d28e86f-8475-4629-8374-ead33b54cc59', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2958add-c3fa-4915-b48a-e5c94c311544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2958add-c3fa-4915-b48a-e5c94c311544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678e7479-46ff-4dc2-8496-6a9e1e006e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Volume 9d28e86f-8475-4629-8374-ead33b54cc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d28e86f-8475-4629-8374-ead33b54cc59', 'volume_size': 1} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-257617693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d28e86f-8475-4629-8374-ead33b54cc59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:01Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Creating volume 9d28e86f-8475-4629-8374-ead33b54cc59 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:00 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:00 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 1073741824 Sep 25 18:02:00 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:01 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 1073741824" returned: 0 in 0.541s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:01 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 Sep 25 18:02:01 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:01 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59" returned: 0 in 0.287s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678e7479-46ff-4dc2-8496-6a9e1e006e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d28e86f-8475-4629-8374-ead33b54cc59', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40398c8-9773-4003-8ffa-b977db365881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Volume volume-9d28e86f-8475-4629-8374-ead33b54cc59 (9d28e86f-8475-4629-8374-ead33b54cc59): created successfully Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40398c8-9773-4003-8ffa-b977db365881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (73925f7b-8399-4f67-8dcd-b2da7e49aed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e05dd33d-449e-4afc-91ba-9794c635ca9e tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Flow 'volume_create_manager' (0b30cd2a-20e4-4ad8-8327-268d3f8c8e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb88235-bb6e-47bf-994e-22e97dce9caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb88235-bb6e-47bf-994e-22e97dce9caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-773099014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3d52eb-f01c-472a-a47a-659d9d2bcd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faedf5b78b44cbebe85a057d2b389f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:04Z,use_quota=True,user_id='6102e362972449a1ab37ce8be5fc2dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02132d0-e588-4eab-98e5-ca7bc1434529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02132d0-e588-4eab-98e5-ca7bc1434529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c3a74d-c89b-4003-a251-dd9c2ea7713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c3a74d-c89b-4003-a251-dd9c2ea7713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3d52eb-f01c-472a-a47a-659d9d2bcd3f', 'volume_name': 'volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f', 'volume_size': 2}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2d54a8-bb39-4257-a349-17410ae91b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2d54a8-bb39-4257-a349-17410ae91b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add69703-8a5d-4f97-8a12-c1392ecc1080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Volume eb3d52eb-f01c-472a-a47a-659d9d2bcd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f', 'volume_size': 2} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-773099014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3d52eb-f01c-472a-a47a-659d9d2bcd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faedf5b78b44cbebe85a057d2b389f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:04Z,use_quota=True,user_id='6102e362972449a1ab37ce8be5fc2dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Creating volume eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:04 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f 2147483648 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:04 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f 2147483648 Sep 25 18:02:04 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (65428799-f751-44a5-a4f7-50677fae9fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33ee3b2-fcce-4774-8b3f-312ab2a8cdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33ee3b2-fcce-4774-8b3f-312ab2a8cdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1561672601',display_name='tempest-VolumesGetTest-Volume-862654038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6811b0d3-1ecd-437b-b852-ef8cfe50992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:04Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41220689-5fcc-4804-894a-0de3ccfea5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41220689-5fcc-4804-894a-0de3ccfea5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461ff96b-eff4-4d66-a457-14959ec6bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461ff96b-eff4-4d66-a457-14959ec6bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6811b0d3-1ecd-437b-b852-ef8cfe50992b', 'volume_name': 'volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e144ac-b754-441c-8f1e-741b387983b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e144ac-b754-441c-8f1e-741b387983b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b9c4f1-a04b-461c-b2ba-15e65a95a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:04 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Volume 6811b0d3-1ecd-437b-b852-ef8cfe50992b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b', 'volume_size': 1} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:04 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f 2147483648" returned: 0 in 0.633s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:04 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f Sep 25 18:02:04 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:05 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" returned: 0 in 0.298s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1561672601',display_name='tempest-VolumesGetTest-Volume-862654038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6811b0d3-1ecd-437b-b852-ef8cfe50992b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:04Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Creating volume 6811b0d3-1ecd-437b-b852-ef8cfe50992b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:05 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add69703-8a5d-4f97-8a12-c1392ecc1080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f', 'volume_size': 2}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fe337d-658b-49bf-9097-0f1c5b074948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:05 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b 1073741824 Sep 25 18:02:05 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:05 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Volume volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f (eb3d52eb-f01c-472a-a47a-659d9d2bcd3f): created successfully Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fe337d-658b-49bf-9097-0f1c5b074948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Flow 'volume_create_manager' (0b30cd2a-20e4-4ad8-8327-268d3f8c8e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-09a45f0d-d15f-4d85-8802-e094264b7530 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Created volume successfully. Sep 25 18:02:05 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b 1073741824" returned: 0 in 0.572s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:05 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b Sep 25 18:02:05 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:06 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b" returned: 0 in 0.342s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b9c4f1-a04b-461c-b2ba-15e65a95a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645817f2-f469-4c05-bfd6-4c07f6b22b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Volume volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b (6811b0d3-1ecd-437b-b852-ef8cfe50992b): created successfully Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645817f2-f469-4c05-bfd6-4c07f6b22b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (65428799-f751-44a5-a4f7-50677fae9fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:06 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c7a24ea1-0ebd-4abd-8dd1-60d2456ccd2b tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Creating offline snapshot 3d758585-da14-4d3a-9e59-44584644d03a of volume eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[275902ba-c048-44ac-a0bd-923b6a156005]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:06 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f Sep 25 18:02:06 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:06 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" returned: 0 in 0.389s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a 2G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:06 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a 2G Sep 25 18:02:06 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:07 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a 2G" returned: 0 in 0.564s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:07 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a Sep 25 18:02:07 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-6811b0d3-1ecd-437b-b852-ef8cfe50992b-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Lock "cinder-6811b0d3-1ecd-437b-b852-ef8cfe50992b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-6811b0d3-1ecd-437b-b852-ef8cfe50992b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-6811b0d3-1ecd-437b-b852-ef8cfe50992b" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae417993-20a8-4ee8-8047-8f97836734c5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:07 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b Sep 25 18:02:07 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:07 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a" returned: 0 in 0.381s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:07 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a is being set with open permissions: ugo+rw Sep 25 18:02:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:07 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a Sep 25 18:02:07 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:08 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b" returned: 0 in 0.708s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:08 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a" returned: 0 in 0.518s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:08 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b Sep 25 18:02:08 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:08 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info Sep 25 18:02:08 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:08 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6811b0d3-1ecd-437b-b852-ef8cfe50992b" returned: 0 in 0.597s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-6811b0d3-1ecd-437b-b852-ef8cfe50992b" released by "delete_volume" :: held 1.390s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Created reservations ['2c35f040-f57f-4af6-8566-77568ceb71b9', '59d6a3a7-f369-4586-8f6e-166b6e68f71b', '58f3c430-3f5b-4c10-a14d-6649d0c86677', '0b696686-7bb8-4164-ad7e-99e3288836d0'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:08 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info" returned: 0 in 0.778s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:08 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info is being set with open permissions: ugo+rw Sep 25 18:02:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:09 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info Sep 25 18:02:09 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:09 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:09 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:09 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.info" returned: 0 in 0.482s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.268s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:09 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.365s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-53cef1ff-674f-452e-aeb5-42a84ef4dbe5 tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Create snapshot completed successfully Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e27e333e-42dd-495c-a14f-75fb438805ad tempest-VolumesGetTest-643517700 None] Lock "cinder-6811b0d3-1ecd-437b-b852-ef8cfe50992b-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-9d28e86f-8475-4629-8374-ead33b54cc59-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Lock "cinder-9d28e86f-8475-4629-8374-ead33b54cc59-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-9d28e86f-8475-4629-8374-ead33b54cc59" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-9d28e86f-8475-4629-8374-ead33b54cc59" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2393a256-3df7-403d-9086-3f152be0a0b8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:10 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 Sep 25 18:02:10 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:10 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59" returned: 0 in 0.574s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "cinder-3d758585-da14-4d3a-9e59-44584644d03a-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:10 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59 Sep 25 18:02:10 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-3d758585-da14-4d3a-9e59-44584644d03a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "cinder-quobyte-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-quobyte-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "cinder-quobyte-3d758585-da14-4d3a-9e59-44584644d03a" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-quobyte-3d758585-da14-4d3a-9e59-44584644d03a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Deleting offline snapshot 3d758585-da14-4d3a-9e59-44584644d03a of volume eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] snapshot_file for this snap is: volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927a9b2-2cfd-4ccb-b1f5-5ef15b58c143]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:10 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a Sep 25 18:02:10 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:11 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9d28e86f-8475-4629-8374-ead33b54cc59" returned: 0 in 0.370s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-9d28e86f-8475-4629-8374-ead33b54cc59" released by "delete_volume" :: held 1.011s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Created reservations ['4684c31b-791b-4930-a341-b079b4d3307e', 'a7bf4bb7-7f7d-4d00-8f78-a2b44b542e5d', '451f728e-682b-4341-b7c9-fcf692ebe022', '74529d51-b180-46f2-b2dc-868355ba23f6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:11 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:11 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:11 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a" returned: 0 in 0.436s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[511c1f7f-e805-4aa2-9188-e4a14d560199]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:11 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f Sep 25 18:02:11 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:11 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.322s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d3524db3-30e4-45e3-a21c-b0b2a8b1c02b tempest-VolumesGetTest-643517700 None] Lock "cinder-9d28e86f-8475-4629-8374-ead33b54cc59-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:11 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" returned: 0 in 0.514s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:11 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a Sep 25 18:02:11 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Flow 'volume_create_manager' (8c4d84fb-5b3d-4de6-93fb-32becab052d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e1aacb-9be1-411c-9fa8-cb369d0d6df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e1aacb-9be1-411c-9fa8-cb369d0d6df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1813573434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56641a27-7ca0-4269-bbee-3c4e236733f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d8826d85d848bbbfd9d38ca45285bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:12Z,use_quota=True,user_id='7c4d7415b1a64999af820ea0907cf79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181204e-23ab-4544-a0bf-9b9ee3c0565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181204e-23ab-4544-a0bf-9b9ee3c0565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:12 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2388e65c-d61b-4df9-88aa-db6c4b34a12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2388e65c-d61b-4df9-88aa-db6c4b34a12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56641a27-7ca0-4269-bbee-3c4e236733f3', 'volume_name': 'volume-56641a27-7ca0-4269-bbee-3c4e236733f3', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01da792-b356-48e7-99a3-9dfd8bbb9f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01da792-b356-48e7-99a3-9dfd8bbb9f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107c53cb-9572-45b2-ae72-af107fed85d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Volume 56641a27-7ca0-4269-bbee-3c4e236733f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56641a27-7ca0-4269-bbee-3c4e236733f3', 'volume_size': 1} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1813573434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56641a27-7ca0-4269-bbee-3c4e236733f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d8826d85d848bbbfd9d38ca45285bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:12Z,use_quota=True,user_id='7c4d7415b1a64999af820ea0907cf79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Creating volume 56641a27-7ca0-4269-bbee-3c4e236733f3 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:12 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a" returned: 0 in 0.616s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:12 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 1073741824 Sep 25 18:02:12 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:12 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a Sep 25 18:02:12 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:12 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f.3d758585-da14-4d3a-9e59-44584644d03a" returned: 0 in 0.506s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-quobyte-3d758585-da14-4d3a-9e59-44584644d03a" released by "_delete_snapshot" :: held 2.262s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-quobyte-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" released by "delete_snapshot" :: held 2.306s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (2b1434d1-3c4f-4dad-9390-7bcb6fafae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3c9105-014b-48cb-890e-ce9aeca0f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3c9105-014b-48cb-890e-ce9aeca0f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1195916975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6b1c01-b607-4f93-bf5d-164a9fe15ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:13Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3894327-435a-42d7-a0d8-99f5e09b47e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3894327-435a-42d7-a0d8-99f5e09b47e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:13 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23732a36-8df7-4f9e-9e8c-114c603f9013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23732a36-8df7-4f9e-9e8c-114c603f9013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'volume_name': 'volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627dfcab-fe44-43d8-a5ee-ddd6ea6eff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627dfcab-fe44-43d8-a5ee-ddd6ea6eff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edd96eb-0b25-41ef-a468-0a76985a5092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Volume be6b1c01-b607-4f93-bf5d-164a9fe15ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'volume_size': 1} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 1073741824" returned: 0 in 0.837s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Created reservations ['87ac3e61-6599-4a92-ae99-78b4b98544b0', '670400f3-c131-4469-a687-b4ef83488bf0', '9b13a991-bc0f-459b-b9ae-73d26f69e687', '95356772-2363-4648-bfc9-93368c0ba7e4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:13 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 Sep 25 18:02:13 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Delete snapshot completed successfully. Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d64e9892-e59c-4d8e-9440-75b540198a5b tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-3d758585-da14-4d3a-9e59-44584644d03a-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:13 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1195916975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6b1c01-b607-4f93-bf5d-164a9fe15ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:13Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Creating volume be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:13 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107c53cb-9572-45b2-ae72-af107fed85d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56641a27-7ca0-4269-bbee-3c4e236733f3', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:13 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 1073741824 Sep 25 18:02:13 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6852f496-9226-45a7-88fe-340141399c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Volume volume-56641a27-7ca0-4269-bbee-3c4e236733f3 (56641a27-7ca0-4269-bbee-3c4e236733f3): created successfully Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6852f496-9226-45a7-88fe-340141399c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Flow 'volume_create_manager' (8c4d84fb-5b3d-4de6-93fb-32becab052d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-09362983-7bfe-411d-b274-cca89a30b981 tempest-AttachVolumeTestJSON-1324949849 None] Created volume successfully. Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "cinder-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "cinder-quobyte-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-quobyte-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b57c7d-03a8-4bae-a596-439bf7e83aad]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:14 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 1073741824" returned: 0 in 0.697s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:14 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f Sep 25 18:02:14 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:14 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 Sep 25 18:02:14 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:14 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:14 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" returned: 0 in 0.517s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:14 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f Sep 25 18:02:14 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edd96eb-0b25-41ef-a468-0a76985a5092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f829ecc-9fb9-46f6-9aab-c47972dc6ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:14 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Volume volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 (be6b1c01-b607-4f93-bf5d-164a9fe15ca9): created successfully Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f829ecc-9fb9-46f6-9aab-c47972dc6ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (2b1434d1-3c4f-4dad-9390-7bcb6fafae0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5ac1caa5-fb76-4c12-aced-9e9b4985ef1b tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:15 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" returned: 0 in 0.376s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-quobyte-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f" released by "delete_volume" :: held 0.995s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Created reservations ['e244cf85-cf84-42be-b7cb-d5f29a399c13', '83707377-2a3d-43dc-9c01-c94f01792e55', 'a5104ee3-16fe-41a4-a62b-6ffbfbf36422', '3fbb5786-52e8-4b6a-93b9-a2402d0c62e6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-c0b416c8-cba1-45d4-80cb-6e9c61ea8595 req-bb470112-a619-472c-9f23-aa2658ed364b tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-c0b416c8-cba1-45d4-80cb-6e9c61ea8595 req-bb470112-a619-472c-9f23-aa2658ed364b tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-c0b416c8-cba1-45d4-80cb-6e9c61ea8595 req-bb470112-a619-472c-9f23-aa2658ed364b tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:15 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:15 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-c0b416c8-cba1-45d4-80cb-6e9c61ea8595 req-bb470112-a619-472c-9f23-aa2658ed364b tempest-AttachVolumeTestJSON-1324949849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-56641a27-7ca0-4269-bbee-3c4e236733f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c789e69-0931-4a85-8b62-80cb9f243d1d', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:02:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-c0b416c8-cba1-45d4-80cb-6e9c61ea8595 req-bb470112-a619-472c-9f23-aa2658ed364b tempest-AttachVolumeTestJSON-1324949849 None] attachment_update completed successfully. Sep 25 18:02:15 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.315s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Deleted volume successfully. Sep 25 18:02:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dafd588c-2043-4291-bc46-7d15b02dbc1a tempest-VolumesSnapshotNegativeTestJSON-1980117318 None] Lock "cinder-eb3d52eb-f01c-472a-a47a-659d9d2bcd3f-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (94090707-3622-4e6d-8582-7d87856ad4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6baf20df-384c-4469-a630-8193119f6d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6baf20df-384c-4469-a630-8193119f6d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1982407876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923f6643-1f59-4f23-aca8-e88ce5b72c8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=be6b1c01-b607-4f93-bf5d-164a9fe15ca9,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:16Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdbf34e-91b8-4c27-bacd-09bcfc8b1d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdbf34e-91b8-4c27-bacd-09bcfc8b1d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecb1990-e20c-4c7e-b508-3a990e45fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecb1990-e20c-4c7e-b508-3a990e45fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '923f6643-1f59-4f23-aca8-e88ce5b72c8a', 'volume_name': 'volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a', 'volume_size': 1, 'source_volid': 'be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'source_volstatus': 'available'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee303cc4-2666-4c1a-be00-aadcb63ea319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee303cc4-2666-4c1a-be00-aadcb63ea319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08590120-2694-48b4-bbb4-ef94ffc9d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:16 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Volume 923f6643-1f59-4f23-aca8-e88ce5b72c8a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a', 'volume_size': 1, 'source_volid': 'be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'source_volstatus': 'available'} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:16 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Cloning volume be6b1c01-b607-4f93-bf5d-164a9fe15ca9 to volume 923f6643-1f59-4f23-aca8-e88ce5b72c8a Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Creating offline snapshot 1d65c29d-b0fc-4e60-a4b8-605517d53475 of volume be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a48af-4071-4240-af62-db0aa76d5c67]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:16 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 Sep 25 18:02:16 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:16 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:16 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 1G Sep 25 18:02:16 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:17 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 1G" returned: 0 in 0.534s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:17 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 Sep 25 18:02:17 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:17 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475" returned: 0 in 0.351s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:17 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 is being set with open permissions: ugo+rw Sep 25 18:02:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:17 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 Sep 25 18:02:17 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:18 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475" returned: 0 in 0.453s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Flow 'volume_create_manager' (5b5de4f9-0e6d-42d9-9f5a-42abaef6e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a507b37-faf4-43ed-919a-f36c6580afaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a507b37-faf4-43ed-919a-f36c6580afaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1730873584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf8972-10c9-4fc1-88e8-091fbfafb482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d8826d85d848bbbfd9d38ca45285bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:18Z,use_quota=True,user_id='7c4d7415b1a64999af820ea0907cf79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5642cacb-9641-4c2e-b9c6-3c6e8a54119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5642cacb-9641-4c2e-b9c6-3c6e8a54119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab89783-8cd6-44aa-b378-5ec2916b3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:18 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab89783-8cd6-44aa-b378-5ec2916b3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cf8972-10c9-4fc1-88e8-091fbfafb482', 'volume_name': 'volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:18 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a38395-cc34-46f5-b9bd-5805448d5bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a38395-cc34-46f5-b9bd-5805448d5bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c69e3c-3e28-4b1e-8811-bdff68828246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:18 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Volume b9cf8972-10c9-4fc1-88e8-091fbfafb482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482', 'volume_size': 1} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:18 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:18 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info is being set with open permissions: ugo+rw Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:18 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info Sep 25 18:02:18 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:18 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.info" returned: 0 in 0.278s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-923f6643-1f59-4f23-aca8-e88ce5b72c8a" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-923f6643-1f59-4f23-aca8-e88ce5b72c8a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] snapshot: 1d65c29d-b0fc-4e60-a4b8-605517d53475, volume: 923f6643-1f59-4f23-aca8-e88ce5b72c8a, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b19cbd-f03c-41f0-91c1-9e7ed45b5c21]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:19 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 Sep 25 18:02:19 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:19 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475" returned: 0 in 0.422s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5e9ea-8d5b-40d7-8b93-8844502d8afb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:19 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 Sep 25 18:02:19 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:19 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" returned: 0 in 0.421s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:02:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:19 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a Sep 25 18:02:19 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:22 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=97,cinder:SELECT=79,cinder:INSERT=24,cinder:DELETE=11 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:02:22 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=87,cinder:UPDATE=94,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:02:28 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a" returned: 0 in 8.521s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9, size 1024.00 MB, duration 8.52 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:02:28 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Converted 1024.00 MB image at 120.14 MB/s Sep 25 18:02:28 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a is being set with open permissions: ugo+rw Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:28 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a Sep 25 18:02:28 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:28 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-923f6643-1f59-4f23-aca8-e88ce5b72c8a" released by "_copy_volume_from_snapshot" :: held 9.713s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-1d65c29d-b0fc-4e60-a4b8-605517d53475" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-1d65c29d-b0fc-4e60-a4b8-605517d53475" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Deleting offline snapshot 1d65c29d-b0fc-4e60-a4b8-605517d53475 of volume be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] snapshot_file for this snap is: volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5e8d6-4f73-4005-be0c-cea0f21f931c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:28 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 Sep 25 18:02:28 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:29 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475" returned: 0 in 0.410s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:02:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1326bfbe-06a0-4d0a-b572-5e8560e626c8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:29 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 Sep 25 18:02:29 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:29 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" returned: 0 in 0.627s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:29 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 Sep 25 18:02:29 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:30 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475" returned: 0 in 0.433s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:30 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475 Sep 25 18:02:30 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:30 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9.1d65c29d-b0fc-4e60-a4b8-605517d53475" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-1d65c29d-b0fc-4e60-a4b8-605517d53475" released by "_delete_snapshot" :: held 1.893s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.420s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.308s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1730873584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf8972-10c9-4fc1-88e8-091fbfafb482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d8826d85d848bbbfd9d38ca45285bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:18Z,use_quota=True,user_id='7c4d7415b1a64999af820ea0907cf79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Creating volume b9cf8972-10c9-4fc1-88e8-091fbfafb482 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:30 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:30 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 1073741824 Sep 25 18:02:30 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08590120-2694-48b4-bbb4-ef94ffc9d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a', 'volume_size': 1, 'source_volid': 'be6b1c01-b607-4f93-bf5d-164a9fe15ca9', 'source_volstatus': 'available'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642382f-6e8f-42a6-82ad-d078fc0c08b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Volume volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a (923f6643-1f59-4f23-aca8-e88ce5b72c8a): created successfully Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642382f-6e8f-42a6-82ad-d078fc0c08b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (94090707-3622-4e6d-8582-7d87856ad4f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c99e602e-734c-4ec7-8ff6-333594f1f4a9 tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:31 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 1073741824" returned: 0 in 0.515s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:31 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 Sep 25 18:02:31 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:31 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482" returned: 0 in 0.291s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c69e3c-3e28-4b1e-8811-bdff68828246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43aad0-d62f-4d83-85d8-b595312dc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:31 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Volume volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 (b9cf8972-10c9-4fc1-88e8-091fbfafb482): created successfully Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43aad0-d62f-4d83-85d8-b595312dc71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Flow 'volume_create_manager' (5b5de4f9-0e6d-42d9-9f5a-42abaef6e48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2b4697f2-aa31-4d7e-b874-f344b953fcbc tempest-AttachVolumeTestJSON-1324949849 None] Created volume successfully. Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (8cb72b21-59d0-475b-b3ed-7abe5c821fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717cd242-4ba9-4f94-be25-def5033ad4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717cd242-4ba9-4f94-be25-def5033ad4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-209545720',display_name='tempest-VolumesGetTest-Volume-736463143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5badf722-539d-424d-a8b4-4206328e0fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:33Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c111aee-69e3-4b9d-9c1d-610ec88f1c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c111aee-69e3-4b9d-9c1d-610ec88f1c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab54d3b-8b93-4703-bab0-c82f193e8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab54d3b-8b93-4703-bab0-c82f193e8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5badf722-539d-424d-a8b4-4206328e0fb0', 'volume_name': 'volume-5badf722-539d-424d-a8b4-4206328e0fb0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf0426e-c197-48d4-9f39-dc6a78dfd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf0426e-c197-48d4-9f39-dc6a78dfd205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4d4d21-466f-48f9-addc-d1f03691b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Volume 5badf722-539d-424d-a8b4-4206328e0fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5badf722-539d-424d-a8b4-4206328e0fb0', 'volume_size': 1} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-209545720',display_name='tempest-VolumesGetTest-Volume-736463143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5badf722-539d-424d-a8b4-4206328e0fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:33Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Creating volume 5badf722-539d-424d-a8b4-4206328e0fb0 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-021014ff-6b80-4252-a261-993c7459b1bb req-3b286308-7e14-433f-a279-2546d147b89e tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:32 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 1073741824 Sep 25 18:02:32 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:33 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 1073741824" returned: 0 in 0.466s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:33 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 Sep 25 18:02:33 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:33 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0" returned: 0 in 0.296s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-021014ff-6b80-4252-a261-993c7459b1bb req-3b286308-7e14-433f-a279-2546d147b89e tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.787s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-021014ff-6b80-4252-a261-993c7459b1bb req-3b286308-7e14-433f-a279-2546d147b89e tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4d4d21-466f-48f9-addc-d1f03691b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5badf722-539d-424d-a8b4-4206328e0fb0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752bcf48-3cde-409b-93a5-5c9c882d5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Volume volume-5badf722-539d-424d-a8b4-4206328e0fb0 (5badf722-539d-424d-a8b4-4206328e0fb0): created successfully Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752bcf48-3cde-409b-93a5-5c9c882d5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (8cb72b21-59d0-475b-b3ed-7abe5c821fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-46f3aa5e-586f-4f1b-8601-1d5f011d6440 tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-021014ff-6b80-4252-a261-993c7459b1bb req-3b286308-7e14-433f-a279-2546d147b89e tempest-AttachVolumeTestJSON-1324949849 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf68518b-e128-491c-a44c-21b5c8fcf25b', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:02:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-021014ff-6b80-4252-a261-993c7459b1bb req-3b286308-7e14-433f-a279-2546d147b89e tempest-AttachVolumeTestJSON-1324949849 None] attachment_update completed successfully. Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Flow 'volume_create_manager' (a43f3574-defd-4995-9d84-cabc340b4623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a0aef7-d2d0-405d-af5c-7cedc09aab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a0aef7-d2d0-405d-af5c-7cedc09aab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803838880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd991eed-44bb-461b-b090-3f7c50706b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84f71e03b4eebbfab880634d6aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:34Z,use_quota=True,user_id='87bbd3c7559448c5938cfe4d93038adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5f3308-8a37-4834-8c0e-c77aa0a4b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5f3308-8a37-4834-8c0e-c77aa0a4b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78feb838-8455-4c59-bb69-77e2c8429c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78feb838-8455-4c59-bb69-77e2c8429c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd991eed-44bb-461b-b090-3f7c50706b9e', 'volume_name': 'volume-bd991eed-44bb-461b-b090-3f7c50706b9e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee18b44-5edb-45ee-a2e1-791d15fec03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee18b44-5edb-45ee-a2e1-791d15fec03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310f4185-603d-4bcc-9beb-b4d2116abf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Volume bd991eed-44bb-461b-b090-3f7c50706b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd991eed-44bb-461b-b090-3f7c50706b9e', 'volume_size': 1} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803838880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd991eed-44bb-461b-b090-3f7c50706b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a84f71e03b4eebbfab880634d6aa38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:34Z,use_quota=True,user_id='87bbd3c7559448c5938cfe4d93038adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Creating volume bd991eed-44bb-461b-b090-3f7c50706b9e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:34 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:34 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e 1073741824 Sep 25 18:02:34 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-5badf722-539d-424d-a8b4-4206328e0fb0-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Lock "cinder-5badf722-539d-424d-a8b4-4206328e0fb0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-5badf722-539d-424d-a8b4-4206328e0fb0" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:35 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-5badf722-539d-424d-a8b4-4206328e0fb0" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e 1073741824" returned: 0 in 0.653s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[529fd8da-b41b-4256-9520-735312c476e6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:35 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e Sep 25 18:02:35 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:35 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 Sep 25 18:02:35 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:35 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:35 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0" returned: 0 in 0.507s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:35 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0 Sep 25 18:02:35 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310f4185-603d-4bcc-9beb-b4d2116abf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd991eed-44bb-461b-b090-3f7c50706b9e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cf0989-6af3-4f43-91d2-0bb88fa4b42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:35 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Volume volume-bd991eed-44bb-461b-b090-3f7c50706b9e (bd991eed-44bb-461b-b090-3f7c50706b9e): created successfully Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cf0989-6af3-4f43-91d2-0bb88fa4b42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Flow 'volume_create_manager' (a43f3574-defd-4995-9d84-cabc340b4623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-72a3bd9b-06e7-4c7c-8e2d-fb176676fa9a tempest-AttachVolumeNegativeTest-460397942 None] Created volume successfully. Sep 25 18:02:35 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5badf722-539d-424d-a8b4-4206328e0fb0" returned: 0 in 0.323s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-5badf722-539d-424d-a8b4-4206328e0fb0" released by "delete_volume" :: held 0.893s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Created reservations ['10fd5df3-57e5-49e6-8ecf-234115267033', 'c54d32ac-c174-4844-8065-9c0140dceb69', '6c0c967f-b8c6-48f3-bd5c-6f548f45d97d', '159aba43-30f2-4d2e-b8ef-1fd58e921a18'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:36 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:36 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-923f6643-1f59-4f23-aca8-e88ce5b72c8a-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Lock "cinder-923f6643-1f59-4f23-aca8-e88ce5b72c8a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:36 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-923f6643-1f59-4f23-aca8-e88ce5b72c8a" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-079eb8c8-f720-4637-9b3b-837c9d7140e4 tempest-VolumesGetTest-643517700 None] Lock "cinder-5badf722-539d-424d-a8b4-4206328e0fb0-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-923f6643-1f59-4f23-aca8-e88ce5b72c8a" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7272db-08e9-4c70-9ba3-be75dc3f4345]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:36 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a Sep 25 18:02:36 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:37 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a" returned: 0 in 0.570s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:37 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a Sep 25 18:02:37 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-f0a312fd-522d-49eb-9407-a861c0a5a621 req-224be0e3-79c6-409a-a3e3-962513f280c7 tempest-AttachVolumeTestJSON-1324949849 None] Terminate volume connection completed successfully. Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-f0a312fd-522d-49eb-9407-a861c0a5a621 req-224be0e3-79c6-409a-a3e3-962513f280c7 tempest-AttachVolumeTestJSON-1324949849 None] Deleting attachment 9c789e69-0931-4a85-8b62-80cb9f243d1d. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-d4c9b8e1-be53-43e9-8f54-f1de7718c9d7 req-20ed9fd3-dc14-43c7-9b47-5818b3d9cb6f tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-d4c9b8e1-be53-43e9-8f54-f1de7718c9d7 req-20ed9fd3-dc14-43c7-9b47-5818b3d9cb6f tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-d4c9b8e1-be53-43e9-8f54-f1de7718c9d7 req-20ed9fd3-dc14-43c7-9b47-5818b3d9cb6f tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-d4c9b8e1-be53-43e9-8f54-f1de7718c9d7 req-20ed9fd3-dc14-43c7-9b47-5818b3d9cb6f tempest-AttachVolumeNegativeTest-460397942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-bd991eed-44bb-461b-b090-3f7c50706b9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a089c955-4597-40b1-aae1-a0e642d0c5c3', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:02:37 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-923f6643-1f59-4f23-aca8-e88ce5b72c8a" returned: 0 in 0.401s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-d4c9b8e1-be53-43e9-8f54-f1de7718c9d7 req-20ed9fd3-dc14-43c7-9b47-5818b3d9cb6f tempest-AttachVolumeNegativeTest-460397942 None] attachment_update completed successfully. Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-923f6643-1f59-4f23-aca8-e88ce5b72c8a" released by "delete_volume" :: held 1.046s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Created reservations ['f94463e3-26d6-4eed-806a-a237698259ed', 'd09a92ee-f593-4d80-a0a0-e97c189412b4', 'cc10fd11-3a18-460c-b376-40b53ecc1ad8', '66189bee-d0fb-44e9-a9f5-2278e6338808'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:37 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:37 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:38 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.375s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95b0f652-8e42-47ef-83bd-546fd082c018 tempest-VolumesGetTest-643517700 None] Lock "cinder-923f6643-1f59-4f23-aca8-e88ce5b72c8a-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-be6b1c01-b607-4f93-bf5d-164a9fe15ca9-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Lock "cinder-be6b1c01-b607-4f93-bf5d-164a9fe15ca9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9634b5eb-e03c-4be8-8b12-256e4a1c8011]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-29931f5b-842b-4da3-a129-315c6c701c0c req-7ab6ab7f-7554-451d-ac49-9e246207fac1 tempest-AttachVolumeTestJSON-1324949849 None] Terminate volume connection completed successfully. Sep 25 18:02:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-29931f5b-842b-4da3-a129-315c6c701c0c req-7ab6ab7f-7554-451d-ac49-9e246207fac1 tempest-AttachVolumeTestJSON-1324949849 None] Deleting attachment bf68518b-e128-491c-a44c-21b5c8fcf25b. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:02:38 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 Sep 25 18:02:38 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:39 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" returned: 0 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:39 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9 Sep 25 18:02:39 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:39 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" returned: 0 in 0.342s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-be6b1c01-b607-4f93-bf5d-164a9fe15ca9" released by "delete_volume" :: held 0.843s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Created reservations ['159d4ef2-b8a8-4b01-898f-075b6256eda9', 'c10b2d37-8dfb-4a83-95ca-8400db9be78d', '96537523-dfa6-46e8-b2b1-b0c5dcf8ca61', '1788e62a-a86c-4e84-80cd-1696d24b2844'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:39 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:39 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:40 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.506s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:40 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f016c61c-4815-4029-a46e-c6e8d28e73f0 tempest-VolumesGetTest-643517700 None] Lock "cinder-be6b1c01-b607-4f93-bf5d-164a9fe15ca9-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-8b5d648e-f041-4c1e-92b8-1075156af1c0 req-44419de9-cb87-45f9-a6bb-38012ae31d15 tempest-AttachVolumeNegativeTest-460397942 None] Terminate volume connection completed successfully. Sep 25 18:02:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-8b5d648e-f041-4c1e-92b8-1075156af1c0 req-44419de9-cb87-45f9-a6bb-38012ae31d15 tempest-AttachVolumeNegativeTest-460397942 None] Deleting attachment a089c955-4597-40b1-aae1-a0e642d0c5c3. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (4f945f11-1304-4337-bb1e-63d963b655c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3785d363-68b3-453a-a7e3-30e6134b8c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3785d363-68b3-453a-a7e3-30e6134b8c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-631348208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17affb56-2ee3-4037-8f8d-e0664c769fe9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:41Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759e8d26-f185-4706-977c-9cfaf392b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759e8d26-f185-4706-977c-9cfaf392b99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499e6788-e514-4455-90c9-851bedaa8808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:41 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499e6788-e514-4455-90c9-851bedaa8808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17affb56-2ee3-4037-8f8d-e0664c769fe9', 'volume_name': 'volume-17affb56-2ee3-4037-8f8d-e0664c769fe9', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa3730c-e57d-418d-9e4e-fe8e8ee64736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa3730c-e57d-418d-9e4e-fe8e8ee64736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bed3bf-a493-4b5d-8601-002a757ee637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:42 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Volume 17affb56-2ee3-4037-8f8d-e0664c769fe9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17affb56-2ee3-4037-8f8d-e0664c769fe9', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Trying to clone 17affb56-2ee3-4037-8f8d-e0664c769fe9 from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:02:42 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Image download 20.69 MB at 20.69 MB/s Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c042d2e-c857-4810-8dc7-9868c1d2b29e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:42 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD Sep 25 18:02:42 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:43 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 is fetched for user 3099d0fdc5c14cfc8aba36d1f6e949c5. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[81582671-526f-42c3-931e-0185191fc10d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:43 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD Sep 25 18:02:43 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:43 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-631348208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17affb56-2ee3-4037-8f8d-e0664c769fe9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:41Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Creating volume 17affb56-2ee3-4037-8f8d-e0664c769fe9 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:43 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:43 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 1073741824 Sep 25 18:02:43 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:44 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 1073741824" returned: 0 in 0.661s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:44 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 Sep 25 18:02:44 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:44 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9" returned: 0 in 0.339s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Attempting download of cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume 17affb56-2ee3-4037-8f8d-e0664c769fe9. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079ea8f-1115-4889-b006-f605c5d63dce]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:45 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te Sep 25 18:02:45 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:45 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te" returned: 0 in 0.441s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:45 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te Sep 25 18:02:45 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:45 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te" returned: 1 in 0.357s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_h6shz9te' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:02:45 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13459e2-73fb-4a9e-b5cc-57635fafdf16]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:45 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD Sep 25 18:02:45 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:46 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:46 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 was qcow2, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:02:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:46 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 Sep 25 18:02:46 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "cinder-b9cf8972-10c9-4fc1-88e8-091fbfafb482-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-b9cf8972-10c9-4fc1-88e8-091fbfafb482-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "cinder-quobyte-b9cf8972-10c9-4fc1-88e8-091fbfafb482" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-quobyte-b9cf8972-10c9-4fc1-88e8-091fbfafb482" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dc6533-c161-44b3-a269-6373b40131ef]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:48 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 Sep 25 18:02:48 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:48 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9" returned: 0 in 2.781s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_3tx9imh8devstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:02:48 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Converted 112.00 MB image at 40.26 MB/s Sep 25 18:02:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:49 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 1G Sep 25 18:02:49 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:49 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482" returned: 0 in 0.557s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:49 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482 Sep 25 18:02:49 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:49 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 1G" returned: 0 in 0.450s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Downloaded image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume 17affb56-2ee3-4037-8f8d-e0664c769fe9 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 for user 3099d0fdc5c14cfc8aba36d1f6e949c5 is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Marking volume 17affb56-2ee3-4037-8f8d-e0664c769fe9 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Copying metadata from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 to 17affb56-2ee3-4037-8f8d-e0664c769fe9. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Creating volume glance metadata for volume 17affb56-2ee3-4037-8f8d-e0664c769fe9 backed by image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bed3bf-a493-4b5d-8601-002a757ee637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17affb56-2ee3-4037-8f8d-e0664c769fe9', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9ce690-7e22-4145-b79b-233754236315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:49 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Volume volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 (17affb56-2ee3-4037-8f8d-e0664c769fe9): created successfully Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9ce690-7e22-4145-b79b-233754236315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (4f945f11-1304-4337-bb1e-63d963b655c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:49 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d70ba0b7-7cbc-415d-8579-1971869d87a9 tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b9cf8972-10c9-4fc1-88e8-091fbfafb482" returned: 0 in 0.389s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-quobyte-b9cf8972-10c9-4fc1-88e8-091fbfafb482" released by "delete_volume" :: held 1.026s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Created reservations ['070d8758-5769-4475-83a3-819181f03b4b', 'd9a7a077-016d-4ddc-abe8-4e3bc741ee82', '6f8fa758-1614-4f64-8352-c4e3e249aaad', 'aa606cf8-c43c-4682-8299-3173c5b9e977'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:49 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:49 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:50 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Deleted volume successfully. Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dbfbba33-cf45-457e-a762-1328a784fdd8 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-b9cf8972-10c9-4fc1-88e8-091fbfafb482-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (6daaa8ee-02a1-4176-a504-271357641806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e387a2d-c257-4153-8bac-ea1de24bb4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e387a2d-c257-4153-8bac-ea1de24bb4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1133695414',display_name='tempest-VolumesGetTest-Volume-1633739976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eae2689-5178-4949-88ad-7e41443b7a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:51Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31983e2-bed8-45ae-8c48-a12d564f48f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31983e2-bed8-45ae-8c48-a12d564f48f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c20aaa2-7ff1-45b6-b6ec-117a469a696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c20aaa2-7ff1-45b6-b6ec-117a469a696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eae2689-5178-4949-88ad-7e41443b7a49', 'volume_name': 'volume-5eae2689-5178-4949-88ad-7e41443b7a49', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9038de0f-ca5b-48bd-9809-58187bc31e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9038de0f-ca5b-48bd-9809-58187bc31e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb59c8c8-5028-449e-b721-0aa62af2a40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Volume 5eae2689-5178-4949-88ad-7e41443b7a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eae2689-5178-4949-88ad-7e41443b7a49', 'volume_size': 1} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:02:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1133695414',display_name='tempest-VolumesGetTest-Volume-1633739976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eae2689-5178-4949-88ad-7e41443b7a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7be695b39f46fc9402c4f503449516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:02:51Z,use_quota=True,user_id='3099d0fdc5c14cfc8aba36d1f6e949c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Creating volume 5eae2689-5178-4949-88ad-7e41443b7a49 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:02:50 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:02:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:50 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 1073741824 Sep 25 18:02:50 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "cinder-56641a27-7ca0-4269-bbee-3c4e236733f3-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-56641a27-7ca0-4269-bbee-3c4e236733f3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "cinder-quobyte-56641a27-7ca0-4269-bbee-3c4e236733f3" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-quobyte-56641a27-7ca0-4269-bbee-3c4e236733f3" acquired by "delete_volume" :: waited 0.035s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[709dfeb0-46d9-4d48-80c1-147fa58b3e50]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:51 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 Sep 25 18:02:51 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:51 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 1073741824" returned: 0 in 0.669s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "cinder-bd991eed-44bb-461b-b090-3f7c50706b9e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:51 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 Sep 25 18:02:51 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-bd991eed-44bb-461b-b090-3f7c50706b9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "cinder-quobyte-bd991eed-44bb-461b-b090-3f7c50706b9e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-quobyte-bd991eed-44bb-461b-b090-3f7c50706b9e" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ed46d0-e12e-455e-8564-5328c9672937]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:51 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3" returned: 0 in 0.567s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:51 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3 Sep 25 18:02:51 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:51 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e Sep 25 18:02:51 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:51 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49" returned: 0 in 0.390s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb59c8c8-5028-449e-b721-0aa62af2a40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eae2689-5178-4949-88ad-7e41443b7a49', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436944ea-f0c9-4477-b36f-2a66cb99d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:02:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Volume volume-5eae2689-5178-4949-88ad-7e41443b7a49 (5eae2689-5178-4949-88ad-7e41443b7a49): created successfully Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436944ea-f0c9-4477-b36f-2a66cb99d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Flow 'volume_create_manager' (6daaa8ee-02a1-4176-a504-271357641806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:02:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-146958d9-cf71-4625-9614-262d8c98a7d9 tempest-VolumesGetTest-643517700 None] Created volume successfully. Sep 25 18:02:52 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-56641a27-7ca0-4269-bbee-3c4e236733f3" returned: 0 in 0.314s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-quobyte-56641a27-7ca0-4269-bbee-3c4e236733f3" released by "delete_volume" :: held 0.934s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:52 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e" returned: 0 in 0.451s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Created reservations ['e16c962a-c7f9-4bc3-9f9d-23e34ae40be0', '3fee7084-6d21-40f9-af6c-add55567838e', '14d6002c-195b-4a6c-9693-b73355284dec', 'f1866836-cb45-4876-b40d-3c6124bc8e99'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:52 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e Sep 25 18:02:52 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:52 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:52 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:52 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bd991eed-44bb-461b-b090-3f7c50706b9e" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-quobyte-bd991eed-44bb-461b-b090-3f7c50706b9e" released by "delete_volume" :: held 0.873s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Created reservations ['6ef8b351-002a-4584-84b9-ab66fd42e924', '247a0b3f-3894-415c-bcc0-9cb406cadf2a', 'b84c74a9-7e7a-48a1-bb51-f9886f5d308f', '0e5acea4-9713-4f2d-8d56-f620a3e0a79b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:52 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.288s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Deleted volume successfully. Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84542804-ed9c-4fe1-a60f-e62c2d0550be tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-56641a27-7ca0-4269-bbee-3c4e236733f3-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:52 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:52 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:53 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.314s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Deleted volume successfully. Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "cinder-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-338e3e06-21ad-4a0a-b76c-dfeca29d35e7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-bd991eed-44bb-461b-b090-3f7c50706b9e-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-5eae2689-5178-4949-88ad-7e41443b7a49-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "cinder-quobyte-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Lock "cinder-5eae2689-5178-4949-88ad-7e41443b7a49-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-quobyte-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd" acquired by "delete_volume" :: waited 0.035s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13706e1-463d-499a-8e4d-c5be213f97d9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-5eae2689-5178-4949-88ad-7e41443b7a49" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-5eae2689-5178-4949-88ad-7e41443b7a49" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373fd7c-a75c-4ad7-b22d-f3c0a633f418]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:53 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd Sep 25 18:02:53 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:53 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 Sep 25 18:02:53 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "cinder-775c002a-4c76-477d-abd3-28b44d1fc267-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-775c002a-4c76-477d-abd3-28b44d1fc267-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "cinder-quobyte-775c002a-4c76-477d-abd3-28b44d1fc267" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-quobyte-775c002a-4c76-477d-abd3-28b44d1fc267" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8804034-3d71-4b7c-85f1-2ff1b5bbd3ec]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:53 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd" returned: 0 in 0.580s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:53 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49" returned: 0 in 0.491s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:53 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd Sep 25 18:02:53 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:53 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49 Sep 25 18:02:53 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:53 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 Sep 25 18:02:53 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:54 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5eae2689-5178-4949-88ad-7e41443b7a49" returned: 0 in 0.336s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:54 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd" returned: 0 in 0.363s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-5eae2689-5178-4949-88ad-7e41443b7a49" released by "delete_volume" :: held 0.902s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-quobyte-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd" released by "delete_volume" :: held 1.030s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:54 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267" returned: 0 in 0.515s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:54 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267 Sep 25 18:02:54 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Created reservations ['3d6a30f4-9fdf-4cf4-93aa-e248cbeb0cda', '7ccf1b6f-e7ab-436f-b8c0-98711a0e1b05', '77df3c42-508f-4ddd-b9f2-57e47c166a6c', 'f99a97e7-9a76-4e84-8edc-67901841e097'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Created reservations ['56d5e697-0b2f-4afc-a3ad-2e760a5b1cb1', 'ac05ae57-f8ed-48d8-b3ab-892f65ede0cd', '369f9edf-20f2-4f46-aca8-21087ee4e1f2', '0b9b41d2-b278-4bbd-a884-45560f586326'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:54 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:54 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:54 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:54 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:54 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-775c002a-4c76-477d-abd3-28b44d1fc267" returned: 0 in 0.429s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-quobyte-775c002a-4c76-477d-abd3-28b44d1fc267" released by "delete_volume" :: held 1.041s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Created reservations ['f52900e2-058e-4a5b-b7f5-a4632e6a7f59', 'd42b512c-1b77-4d5b-ad60-2f2082ad6ba0', 'be4275ac-e065-4571-9a5b-8ff545235ca0', '2810fab6-c6fc-481e-adca-e18b3c981d60'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:54 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.396s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:54 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Deleted volume successfully. Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9a17bd3d-b6d6-484d-949d-c3e961e297c7 tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-21ecc879-d1de-4f15-8cfd-6f4f773b9bdd-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:55 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:55 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:55 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.632s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5ef7fb29-22bc-4467-a077-c6eb498f15af tempest-VolumesGetTest-643517700 None] Lock "cinder-5eae2689-5178-4949-88ad-7e41443b7a49-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:55 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.487s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Deleted volume successfully. Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f38ff979-ae03-4f8d-8cb4-abbc9c5a0337 tempest-AttachVolumeTestJSON-1324949849 None] Lock "cinder-775c002a-4c76-477d-abd3-28b44d1fc267-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-17affb56-2ee3-4037-8f8d-e0664c769fe9-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Lock "cinder-17affb56-2ee3-4037-8f8d-e0664c769fe9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Acquiring lock "cinder-quobyte-17affb56-2ee3-4037-8f8d-e0664c769fe9" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-17affb56-2ee3-4037-8f8d-e0664c769fe9" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced28584-3225-45fc-8416-e0b328b21fd1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "cinder-1ab127ad-9939-4f54-80e0-598a727c23bb-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-1ab127ad-9939-4f54-80e0-598a727c23bb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:55 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:55 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:55 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 Sep 25 18:02:55 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "cinder-quobyte-1ab127ad-9939-4f54-80e0-598a727c23bb" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-quobyte-1ab127ad-9939-4f54-80e0-598a727c23bb" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd80bb4-3cba-4724-bafa-f0eab35574d0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:56 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb Sep 25 18:02:56 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:56 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:02:56 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9" returned: 0 in 0.779s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:56 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9 Sep 25 18:02:56 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:56 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb" returned: 0 in 0.592s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:56 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb Sep 25 18:02:56 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:56 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-17affb56-2ee3-4037-8f8d-e0664c769fe9" returned: 0 in 0.388s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Lock "cinder-quobyte-17affb56-2ee3-4037-8f8d-e0664c769fe9" released by "delete_volume" :: held 1.260s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:57 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1ab127ad-9939-4f54-80e0-598a727c23bb" returned: 0 in 0.409s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-quobyte-1ab127ad-9939-4f54-80e0-598a727c23bb" released by "delete_volume" :: held 1.067s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Created reservations ['549adb25-b79a-49eb-9a8f-f986d688eab4', 'eeb771ab-f2f4-4e1f-857e-71a02ea5ed7e', 'e6180ba2-80f2-42bc-8e5d-59f3fa90a0ee', '43b1e081-8437-4850-a42c-ce0547976096'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Created reservations ['b81249de-59f4-436f-abac-6f85a90cdb5e', '3c4e4c13-b197-4eaf-9e76-f5dd266ca511', 'a47c9fe3-8144-44c2-8131-008f39d5666f', 'ba4a2707-3c2e-40e2-bf74-72d4ca20cc7b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:57 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:57 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:02:57 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:02:57 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:02:57 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Deleted volume successfully. Sep 25 18:02:57 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:02:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Deleted volume successfully. Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-350de8d2-fe93-433d-8145-22a3f70e5db3 tempest-VolumesGetTest-643517700 None] Lock "cinder-17affb56-2ee3-4037-8f8d-e0664c769fe9-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:02:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-349175f6-dc5c-4b66-bec6-593023cb81ad tempest-AttachVolumeNegativeTest-460397942 None] Lock "cinder-1ab127ad-9939-4f54-80e0-598a727c23bb-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Flow 'volume_create_manager' (28dd94d4-dff2-49e5-9bcf-6651d1c4aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df32898b-4e3a-4b41-b427-057a7435bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df32898b-4e3a-4b41-b427-057a7435bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1116114035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f1680c-9e62-473a-96bd-99274ae1026a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2712e6a5d1746949d0bafdb4d1993c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:06Z,use_quota=True,user_id='2cea45e040fa494c99f043474e0e1edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60ed568-324f-4dbb-bc22-83cc199b1544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60ed568-324f-4dbb-bc22-83cc199b1544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61210af5-9a96-4831-a504-8869a3313e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61210af5-9a96-4831-a504-8869a3313e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f1680c-9e62-473a-96bd-99274ae1026a', 'volume_name': 'volume-18f1680c-9e62-473a-96bd-99274ae1026a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7990012-ec32-4f8f-a369-c2287a475b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7990012-ec32-4f8f-a369-c2287a475b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531c5961-2029-453b-8cef-1add76cade24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Volume 18f1680c-9e62-473a-96bd-99274ae1026a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f1680c-9e62-473a-96bd-99274ae1026a', 'volume_size': 1} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1116114035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f1680c-9e62-473a-96bd-99274ae1026a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2712e6a5d1746949d0bafdb4d1993c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:06Z,use_quota=True,user_id='2cea45e040fa494c99f043474e0e1edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Creating volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:06 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:06 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a 1073741824 Sep 25 18:03:06 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Flow 'volume_create_manager' (058b62f5-6bb0-4413-bae4-c32eb58e89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe59945-d978-465b-a244-a301d33a3182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe59945-d978-465b-a244-a301d33a3182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-148818509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9080fd2-8915-4e09-afa4-5e938d1763e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4902f2a2564d899050ef6fe22efc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:07Z,use_quota=True,user_id='fe55ca229bcd4120bb6994ae195bc4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bb2afc-b873-47e2-b8ac-8d57fb723ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bb2afc-b873-47e2-b8ac-8d57fb723ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061c080-24a6-449b-ad6b-7a3d1fded7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061c080-24a6-449b-ad6b-7a3d1fded7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9080fd2-8915-4e09-afa4-5e938d1763e5', 'volume_name': 'volume-c9080fd2-8915-4e09-afa4-5e938d1763e5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aad0c86-ffc9-431e-b2c8-75a5ece0d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aad0c86-ffc9-431e-b2c8-75a5ece0d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71840d8-d489-4e99-86d4-4f88f2ddb35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Volume c9080fd2-8915-4e09-afa4-5e938d1763e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9080fd2-8915-4e09-afa4-5e938d1763e5', 'volume_size': 1} Sep 25 18:03:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:07 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a 1073741824" returned: 0 in 0.718s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:07 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a Sep 25 18:03:07 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:07 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a" returned: 0 in 0.361s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-148818509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9080fd2-8915-4e09-afa4-5e938d1763e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4902f2a2564d899050ef6fe22efc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:07Z,use_quota=True,user_id='fe55ca229bcd4120bb6994ae195bc4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Creating volume c9080fd2-8915-4e09-afa4-5e938d1763e5 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:07 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531c5961-2029-453b-8cef-1add76cade24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f1680c-9e62-473a-96bd-99274ae1026a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71871c65-73d0-48b2-b0f6-8fd1d3698460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:07 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 1073741824 Sep 25 18:03:07 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Volume volume-18f1680c-9e62-473a-96bd-99274ae1026a (18f1680c-9e62-473a-96bd-99274ae1026a): created successfully Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71871c65-73d0-48b2-b0f6-8fd1d3698460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Flow 'volume_create_manager' (28dd94d4-dff2-49e5-9bcf-6651d1c4aa78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-75d0805a-a9a4-4b3e-a56c-9694f74ae191 tempest-VolumesSnapshotListTestJSON-1607599671 None] Created volume successfully. Sep 25 18:03:08 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 1073741824" returned: 0 in 0.744s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:08 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 Sep 25 18:03:08 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:08 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5" returned: 0 in 0.323s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.372s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71840d8-d489-4e99-86d4-4f88f2ddb35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9080fd2-8915-4e09-afa4-5e938d1763e5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08da11f-f882-4bb2-8b2b-bf6b476e8200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Creating offline snapshot e62106a2-5353-4f05-baa1-92040eda405d of volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:03:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Volume volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 (c9080fd2-8915-4e09-afa4-5e938d1763e5): created successfully Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08da11f-f882-4bb2-8b2b-bf6b476e8200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Flow 'volume_create_manager' (058b62f5-6bb0-4413-bae4-c32eb58e89b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b16986-d2f4-40ec-8a06-74864bd735fc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-636394b5-2003-42da-9068-d27ed5f2b09e tempest-TestMinimumBasicScenario-1638694043 None] Created volume successfully. Sep 25 18:03:08 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a Sep 25 18:03:08 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:09 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a" returned: 0 in 0.859s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:09 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d 1G Sep 25 18:03:09 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:10 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d 1G" returned: 0 in 0.783s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:10 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:10 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-917a3747-a00d-4a74-9cf5-80834356e559 req-672463e3-0c94-43dc-98d7-5fd78594747c tempest-TestMinimumBasicScenario-1638694043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:10 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.316s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:10 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d is being set with open permissions: ugo+rw Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:10 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:10 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:10 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:10 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info Sep 25 18:03:10 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:11 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info" returned: 0 in 0.323s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:11 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info is being set with open permissions: ugo+rw Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:11 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info Sep 25 18:03:11 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Flow 'volume_create_manager' (f28850d2-0706-4278-bdd7-0a599ba790df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513508b6-020d-4930-ae4c-6dfdde4051b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513508b6-020d-4930-ae4c-6dfdde4051b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-306737007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5479059f-986c-4c34-9c04-5c983a5f41ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce47e8a7a674c20af3a1c54224810db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:11Z,use_quota=True,user_id='d8ab8b7e0ce24d6ca22dd1d30cc984d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5acb667-f8ab-4ecd-a238-65195c7b0419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5acb667-f8ab-4ecd-a238-65195c7b0419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93b7d2a-9e29-4910-813d-746f8f8dfbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93b7d2a-9e29-4910-813d-746f8f8dfbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5479059f-986c-4c34-9c04-5c983a5f41ee', 'volume_name': 'volume-5479059f-986c-4c34-9c04-5c983a5f41ee', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf77694a-d0b5-45d4-8b71-4f19837852b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf77694a-d0b5-45d4-8b71-4f19837852b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4c6fb5-630b-48f1-9b4a-c394224ed6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:11 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Volume 5479059f-986c-4c34-9c04-5c983a5f41ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5479059f-986c-4c34-9c04-5c983a5f41ee', 'volume_size': 1} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:11 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.info" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.989s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-917a3747-a00d-4a74-9cf5-80834356e559 req-672463e3-0c94-43dc-98d7-5fd78594747c tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.225s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-917a3747-a00d-4a74-9cf5-80834356e559 req-672463e3-0c94-43dc-98d7-5fd78594747c tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.197s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-306737007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5479059f-986c-4c34-9c04-5c983a5f41ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce47e8a7a674c20af3a1c54224810db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:11Z,use_quota=True,user_id='d8ab8b7e0ce24d6ca22dd1d30cc984d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Creating volume 5479059f-986c-4c34-9c04-5c983a5f41ee {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:11 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:11 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee 1073741824 Sep 25 18:03:11 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dc40faa5-5132-4a0c-8915-3a490e91630b tempest-VolumesSnapshotListTestJSON-1607599671 None] Create snapshot completed successfully Sep 25 18:03:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-917a3747-a00d-4a74-9cf5-80834356e559 req-672463e3-0c94-43dc-98d7-5fd78594747c tempest-TestMinimumBasicScenario-1638694043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-c9080fd2-8915-4e09-afa4-5e938d1763e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '244670a0-65df-49b0-928d-7ee73d50d3bd', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:03:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-917a3747-a00d-4a74-9cf5-80834356e559 req-672463e3-0c94-43dc-98d7-5fd78594747c tempest-TestMinimumBasicScenario-1638694043 None] attachment_update completed successfully. Sep 25 18:03:12 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee 1073741824" returned: 0 in 0.700s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:12 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee Sep 25 18:03:12 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:12 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee" returned: 0 in 0.339s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.092s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4c6fb5-630b-48f1-9b4a-c394224ed6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5479059f-986c-4c34-9c04-5c983a5f41ee', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77a073d-a24d-4778-896f-f75049ccc8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Creating offline snapshot 4aa358f7-2c61-4da2-9028-682ca5fa5f51 of volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:03:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Volume volume-5479059f-986c-4c34-9c04-5c983a5f41ee (5479059f-986c-4c34-9c04-5c983a5f41ee): created successfully Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77a073d-a24d-4778-896f-f75049ccc8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Flow 'volume_create_manager' (f28850d2-0706-4278-bdd7-0a599ba790df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[33032aa1-1372-4e4e-8db8-2343db7915e8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ff3a8089-ec17-4cf8-9b89-b39b06256b57 tempest-VolumesTestJSON-114186642 None] Created volume successfully. Sep 25 18:03:13 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:13 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:13 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.560s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:13 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 1G Sep 25 18:03:13 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:14 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 1G" returned: 0 in 0.908s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:14 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:14 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:14 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.461s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:14 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 is being set with open permissions: ugo+rw Sep 25 18:03:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:14 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:14 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Flow 'volume_create_manager' (c3443960-0836-4933-b7e6-8a596a6d8601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f86344-6afd-4762-bcdb-5a97e2b27835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f86344-6afd-4762-bcdb-5a97e2b27835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1153284106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328bb679-34d3-450c-a120-356116626d45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce47e8a7a674c20af3a1c54224810db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:15Z,use_quota=True,user_id='d8ab8b7e0ce24d6ca22dd1d30cc984d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f3ddd-6003-4c7a-9a17-a374edaf8f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f3ddd-6003-4c7a-9a17-a374edaf8f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f33769-e152-4001-8090-4a80ea947d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f33769-e152-4001-8090-4a80ea947d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328bb679-34d3-450c-a120-356116626d45', 'volume_name': 'volume-328bb679-34d3-450c-a120-356116626d45', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec258082-1a2b-4e3c-8696-f0e766f01116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec258082-1a2b-4e3c-8696-f0e766f01116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26446b75-f57c-439f-8bc2-045cd7d4ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:15 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Volume 328bb679-34d3-450c-a120-356116626d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328bb679-34d3-450c-a120-356116626d45', 'volume_size': 1} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:15 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.159s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1153284106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328bb679-34d3-450c-a120-356116626d45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce47e8a7a674c20af3a1c54224810db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:15Z,use_quota=True,user_id='d8ab8b7e0ce24d6ca22dd1d30cc984d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Creating volume 328bb679-34d3-450c-a120-356116626d45 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:15 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:15 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 1073741824 Sep 25 18:03:15 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f8ae3dca-2c72-4c4f-856c-2263f5ad959c tempest-VolumesSnapshotListTestJSON-1607599671 None] Create snapshot completed successfully Sep 25 18:03:15 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 1073741824" returned: 0 in 0.610s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:16 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 Sep 25 18:03:16 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:16 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.132s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26446b75-f57c-439f-8bc2-045cd7d4ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328bb679-34d3-450c-a120-356116626d45', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1aa818d-ae64-4bc4-a2d4-81a3edb7ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Creating offline snapshot 3e334562-6cdd-4a5e-8f82-479b86dfd9af of volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7639c813-fbcf-4815-9408-04303d7a001d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:16 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Volume volume-328bb679-34d3-450c-a120-356116626d45 (328bb679-34d3-450c-a120-356116626d45): created successfully Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1aa818d-ae64-4bc4-a2d4-81a3edb7ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Flow 'volume_create_manager' (c3443960-0836-4933-b7e6-8a596a6d8601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e8d86593-ce8b-46e0-bcae-f5a1adaec5ef tempest-VolumesTestJSON-114186642 None] Created volume successfully. Sep 25 18:03:16 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:16 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:16 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:16 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af 1G Sep 25 18:03:16 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:17 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af 1G" returned: 0 in 0.740s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:17 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af Sep 25 18:03:17 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:18 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af" returned: 0 in 0.537s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:18 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af is being set with open permissions: ugo+rw Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:18 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af Sep 25 18:03:18 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Flow 'volume_create_manager' (94a16261-341c-4296-b798-7c6724fd455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae524bf3-5f25-4fab-ae07-a79988596ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae524bf3-5f25-4fab-ae07-a79988596ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1034362320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb7217a-96b3-4cef-aa54-a3b3a616521a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce47e8a7a674c20af3a1c54224810db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:18Z,use_quota=True,user_id='d8ab8b7e0ce24d6ca22dd1d30cc984d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:18 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc2391f-cf87-41fe-bfa3-438432cc35a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc2391f-cf87-41fe-bfa3-438432cc35a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0fdffc-2617-4d04-9d59-99d036e891af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0fdffc-2617-4d04-9d59-99d036e891af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb7217a-96b3-4cef-aa54-a3b3a616521a', 'volume_name': 'volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b914edf-7664-4919-899e-7ba8fe8a4db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b914edf-7664-4919-899e-7ba8fe8a4db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bfb8fe-53cb-4de8-9d6a-d5cd6de776f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:18 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Volume 6bb7217a-96b3-4cef-aa54-a3b3a616521a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a', 'volume_size': 1} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af" returned: 0 in 0.434s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1034362320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb7217a-96b3-4cef-aa54-a3b3a616521a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ce47e8a7a674c20af3a1c54224810db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:18Z,use_quota=True,user_id='d8ab8b7e0ce24d6ca22dd1d30cc984d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Creating volume 6bb7217a-96b3-4cef-aa54-a3b3a616521a {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:18 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:18 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a 1073741824 Sep 25 18:03:18 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e422d108-e68b-4b24-8a9c-2ca86e466610 tempest-VolumesSnapshotListTestJSON-1607599671 None] Create snapshot completed successfully Sep 25 18:03:19 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a 1073741824" returned: 0 in 0.536s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:19 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a Sep 25 18:03:19 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:19 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a" returned: 0 in 0.343s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bfb8fe-53cb-4de8-9d6a-d5cd6de776f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea10aa-6eed-49ea-b4ab-98afe98890de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Volume volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a (6bb7217a-96b3-4cef-aa54-a3b3a616521a): created successfully Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ea10aa-6eed-49ea-b4ab-98afe98890de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Flow 'volume_create_manager' (94a16261-341c-4296-b798-7c6724fd455b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4b5d5cfe-389a-4315-a3a6-4e907bf0a06f tempest-VolumesTestJSON-114186642 None] Created volume successfully. Sep 25 18:03:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a7bdef31-4a20-4021-a577-a36cbd088896 tempest-GroupsTest-2050165492 None] Group tempest-Group1-1678642829: creating Sep 25 18:03:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a7bdef31-4a20-4021-a577-a36cbd088896 tempest-GroupsTest-2050165492 None] Group tempest-Group1-1678642829: created successfully Sep 25 18:03:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a7bdef31-4a20-4021-a577-a36cbd088896 tempest-GroupsTest-2050165492 None] Create group completed successfully. Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-3e334562-6cdd-4a5e-8f82-479b86dfd9af-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-3e334562-6cdd-4a5e-8f82-479b86dfd9af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-3e334562-6cdd-4a5e-8f82-479b86dfd9af" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-3e334562-6cdd-4a5e-8f82-479b86dfd9af" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Deleting offline snapshot 3e334562-6cdd-4a5e-8f82-479b86dfd9af of volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] snapshot_file for this snap is: volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db88207-19b8-4de1-965e-6026337e6124]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:20 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af Sep 25 18:03:20 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:21 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af" returned: 0 in 0.495s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[530913c8-73a6-49c5-97e5-0a3c08f63538]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:21 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:21 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f7aa620a-6577-4b40-b3f3-c29ba37f2d41 tempest-GroupsTest-2050165492 None] Group tempest-Group2-246997466: creating Sep 25 18:03:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f7aa620a-6577-4b40-b3f3-c29ba37f2d41 tempest-GroupsTest-2050165492 None] Group tempest-Group2-246997466: created successfully Sep 25 18:03:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f7aa620a-6577-4b40-b3f3-c29ba37f2d41 tempest-GroupsTest-2050165492 None] Create group completed successfully. Sep 25 18:03:21 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.713s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:21 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af Sep 25 18:03:21 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Acquiring lock "cinder-6bb7217a-96b3-4cef-aa54-a3b3a616521a-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Lock "cinder-6bb7217a-96b3-4cef-aa54-a3b3a616521a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Acquiring lock "cinder-quobyte-6bb7217a-96b3-4cef-aa54-a3b3a616521a" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Lock "cinder-quobyte-6bb7217a-96b3-4cef-aa54-a3b3a616521a" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de3e4d-28db-4eb2-a37e-8e922e421e2e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:22 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a Sep 25 18:03:22 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:22 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af" returned: 0 in 0.893s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:22 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af Sep 25 18:03:22 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:22 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a" returned: 0 in 0.608s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:23 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a Sep 25 18:03:23 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:23 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.3e334562-6cdd-4a5e-8f82-479b86dfd9af" returned: 0 in 0.427s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-3e334562-6cdd-4a5e-8f82-479b86dfd9af" released by "_delete_snapshot" :: held 2.715s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" released by "delete_snapshot" :: held 2.747s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=140,cinder:SELECT=107,cinder:INSERT=35,cinder:DELETE=13 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=126,cinder:SELECT=130,cinder:INSERT=34,cinder:DELETE=12 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Created reservations ['74955520-9eea-4600-b144-497a5579ae4a', '41f91ffc-dba3-4d90-bd47-13740ff47860', '02b88b5d-72e6-4156-8b7b-18021af75e28', '840aceb6-e29b-4a4d-ab8a-55e23f7f67e4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:23 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6bb7217a-96b3-4cef-aa54-a3b3a616521a" returned: 0 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Lock "cinder-quobyte-6bb7217a-96b3-4cef-aa54-a3b3a616521a" released by "delete_volume" :: held 1.051s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:23 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Delete snapshot completed successfully. Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a2cc4aed-1eaa-49ed-aa46-b51dbe58be2b tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-3e334562-6cdd-4a5e-8f82-479b86dfd9af-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Created reservations ['d38d5559-2ec5-45d3-929f-9e7482f46607', '4e9af273-5aeb-4b13-969a-76bed0e3c971', 'e4281b39-3a58-4335-978d-727c0f0dccde', '59ca52bc-5dac-4026-b728-3dda3e6ca096'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Flow 'volume_create_manager' (6b6ec4df-b183-48f9-889a-ba3611436c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad7585c-81d6-40cc-8302-8692b95529da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad7585c-81d6-40cc-8302-8692b95529da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-307829228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b89956bf-2eef-4280-8c8a-9d3f41c9ae29,host='devstack@QuobyteHD#QuobyteHD',id=7f1e12ad-3311-473d-8a28-60e5506baca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649568896604b6184a152954834dabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:23Z,use_quota=True,user_id='0fe6b18dbac8477398616589790f53b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae82292f-46c7-4cd7-a5a8-45e47eed9849),volume_type_id=ae82292f-46c7-4cd7-a5a8-45e47eed9849)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8878907-ca1b-4311-82ef-da4299edcfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8878907-ca1b-4311-82ef-da4299edcfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7c2d41-59b2-451b-b297-85145534e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7c2d41-59b2-451b-b297-85145534e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1e12ad-3311-473d-8a28-60e5506baca8', 'volume_name': 'volume-7f1e12ad-3311-473d-8a28-60e5506baca8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3999ab9a-8c1d-47fc-9d56-aff3ed9820a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3999ab9a-8c1d-47fc-9d56-aff3ed9820a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e58979-17b3-47bc-bed3-3a7263345f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Volume 7f1e12ad-3311-473d-8a28-60e5506baca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1e12ad-3311-473d-8a28-60e5506baca8', 'volume_size': 1} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b89956bf-2eef-4280-8c8a-9d3f41c9ae29,created_at=2026-09-25T16:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-307829228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b89956bf-2eef-4280-8c8a-9d3f41c9ae29,host='devstack@QuobyteHD#QuobyteHD',id=7f1e12ad-3311-473d-8a28-60e5506baca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649568896604b6184a152954834dabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:23Z,use_quota=True,user_id='0fe6b18dbac8477398616589790f53b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae82292f-46c7-4cd7-a5a8-45e47eed9849),volume_type_id=ae82292f-46c7-4cd7-a5a8-45e47eed9849)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Creating volume 7f1e12ad-3311-473d-8a28-60e5506baca8 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:23 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-4aa358f7-2c61-4da2-9028-682ca5fa5f51-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:23 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 1073741824 Sep 25 18:03:23 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-4aa358f7-2c61-4da2-9028-682ca5fa5f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-4aa358f7-2c61-4da2-9028-682ca5fa5f51" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-4aa358f7-2c61-4da2-9028-682ca5fa5f51" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Deleting offline snapshot 4aa358f7-2c61-4da2-9028-682ca5fa5f51 of volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:03:23 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:23 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] snapshot_file for this snap is: volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[87adff09-568d-44f8-84d6-cfcc40b6ae11]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:24 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:24 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:24 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Deleted volume successfully. Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb9df979-f4b9-482e-a5e1-2a4408cd472c tempest-VolumesTestJSON-114186642 None] Lock "cinder-6bb7217a-96b3-4cef-aa54-a3b3a616521a-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:24 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 1073741824" returned: 0 in 0.615s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:24 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.451s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8f809-f74b-4a63-9dbd-c7561b477ec6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:24 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 Sep 25 18:03:24 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:24 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:24 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Acquiring lock "cinder-328bb679-34d3-450c-a120-356116626d45-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Lock "cinder-328bb679-34d3-450c-a120-356116626d45-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Acquiring lock "cinder-quobyte-328bb679-34d3-450c-a120-356116626d45" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:24 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8" returned: 0 in 0.296s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Lock "cinder-quobyte-328bb679-34d3-450c-a120-356116626d45" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e58979-17b3-47bc-bed3-3a7263345f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1e12ad-3311-473d-8a28-60e5506baca8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b4e272-fae2-4034-8670-bfe0b6c27e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[09853a38-4560-4617-8f1f-55b744e8fc3b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Volume volume-7f1e12ad-3311-473d-8a28-60e5506baca8 (7f1e12ad-3311-473d-8a28-60e5506baca8): created successfully Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b4e272-fae2-4034-8670-bfe0b6c27e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Flow 'volume_create_manager' (6b6ec4df-b183-48f9-889a-ba3611436c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-219a6a7b-fd88-4e70-9826-caa5e76b1038 tempest-GroupsTest-2050165492 None] Created volume successfully. Sep 25 18:03:24 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.446s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:24 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:24 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:24 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 Sep 25 18:03:24 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:25 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:25 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45 Sep 25 18:03:25 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:25 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.396s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:25 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51 Sep 25 18:03:25 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:25 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-328bb679-34d3-450c-a120-356116626d45" returned: 0 in 0.272s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Lock "cinder-quobyte-328bb679-34d3-450c-a120-356116626d45" released by "delete_volume" :: held 0.740s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:25 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Created reservations ['f6269bfd-a684-4b38-a0cd-bd8ef4a08df9', '88f874b9-706f-41e0-91be-e2c955baf068', 'fd9c65ec-a4a2-4313-863a-74063ac45007', '4a6822a2-1e6f-47c9-ba3c-adb8d018703f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.4aa358f7-2c61-4da2-9028-682ca5fa5f51" returned: 0 in 0.286s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-4aa358f7-2c61-4da2-9028-682ca5fa5f51" released by "_delete_snapshot" :: held 1.701s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" released by "delete_snapshot" :: held 1.750s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Created reservations ['83d6b4aa-065a-4f2b-9026-972b96c480c5', 'c3b5b3e5-7ce2-4df0-8282-c84904300e9f', '36528a98-42f2-4b0e-9ec8-48379c793ae8', '66f32c88-a836-4b2e-9252-9028cd6e988e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:25 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:25 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Delete snapshot completed successfully. Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a6d79831-f621-4918-aa85-1009029720c3 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-4aa358f7-2c61-4da2-9028-682ca5fa5f51-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Acquiring lock "cinder-5479059f-986c-4c34-9c04-5c983a5f41ee-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Lock "cinder-5479059f-986c-4c34-9c04-5c983a5f41ee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Acquiring lock "cinder-quobyte-5479059f-986c-4c34-9c04-5c983a5f41ee" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Lock "cinder-quobyte-5479059f-986c-4c34-9c04-5c983a5f41ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-e62106a2-5353-4f05-baa1-92040eda405d-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:25 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc69e3-b2ca-4468-ac4f-9777c92fb8db]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-e62106a2-5353-4f05-baa1-92040eda405d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Deleted volume successfully. Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-e62106a2-5353-4f05-baa1-92040eda405d" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-50bade45-37c6-47fa-8643-c21ed659a8f7 tempest-VolumesTestJSON-114186642 None] Lock "cinder-328bb679-34d3-450c-a120-356116626d45-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-e62106a2-5353-4f05-baa1-92040eda405d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Deleting offline snapshot e62106a2-5353-4f05-baa1-92040eda405d of volume 18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:03:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] snapshot_file for this snap is: volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a6198-ba0d-48fc-8c19-5f35ed2901b6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:26 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee Sep 25 18:03:26 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:26 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:26 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:26 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee" returned: 0 in 0.505s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:26 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee Sep 25 18:03:26 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:26 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.464s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f1680c-9e62-473a-96bd-99274ae1026a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21f395-ee3a-4c50-8122-224838912c7c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:26 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5479059f-986c-4c34-9c04-5c983a5f41ee" returned: 0 in 0.281s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:26 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a Sep 25 18:03:26 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Lock "cinder-quobyte-5479059f-986c-4c34-9c04-5c983a5f41ee" released by "delete_volume" :: held 0.871s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Acquiring lock "cinder-quobyte-7f1e12ad-3311-473d-8a28-60e5506baca8" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Lock "cinder-quobyte-7f1e12ad-3311-473d-8a28-60e5506baca8" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b22a2b-1249-4bbe-a47d-79a5cee6ff9c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Created reservations ['c869fe3e-1789-4ac2-bcd1-642f6d6ee459', '93a4104e-14ef-49c5-b526-f1561f143d41', '377803ea-607f-4c5e-a529-ee529856dac4', 'b7e5dfe7-d575-43c5-a9f5-220cbb8b9ccc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:26 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 Sep 25 18:03:26 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:27 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:27 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:27 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a" returned: 0 in 0.558s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:27 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:27 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:27 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8" returned: 0 in 0.538s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:27 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.367s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Deleted volume successfully. Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c5bafcf7-dfcf-401b-8c14-d80603398137 tempest-VolumesTestJSON-114186642 None] Lock "cinder-5479059f-986c-4c34-9c04-5c983a5f41ee-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:27 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8 Sep 25 18:03:27 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:27 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.521s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:27 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7f1e12ad-3311-473d-8a28-60e5506baca8" returned: 0 in 0.301s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Lock "cinder-quobyte-7f1e12ad-3311-473d-8a28-60e5506baca8" released by "delete_volume" :: held 0.897s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:27 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d Sep 25 18:03:27 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Created reservations ['e329d174-9c44-43a6-98c1-6af039462648'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:27 devstack cinder-volume[86665]: WARNING cinder.quota [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1550422116 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1550422116, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:03:27 devstack cinder-volume[86665]: WARNING cinder.quota [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1550422116 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1550422116, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Created reservations ['29e84f47-1985-4d1f-beff-0353549b324f', '181c6f9e-dee9-4ae2-afad-a229ecd3f971', '2cbfe763-ff88-4d2b-9eac-67eac5d54f12', '05666f3d-99d4-4959-aadb-7b8103d49f71'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:27 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a.e62106a2-5353-4f05-baa1-92040eda405d" returned: 0 in 0.336s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:27 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:27 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-e62106a2-5353-4f05-baa1-92040eda405d" released by "_delete_snapshot" :: held 2.099s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" released by "delete_snapshot" :: held 2.143s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Created reservations ['1fe1077e-b109-4480-8b2e-33c2d5e97985', '8171ecd8-5ef2-45f5-8231-79663efa13d4', '87fbb17c-aa50-4a82-904b-df08893af1b9', '5abf0573-e5d2-410f-9c1b-a8dd998a20b2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Created reservations ['9c68f643-c16a-4c9b-9f7a-5f355c669e5b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Delete snapshot completed successfully. Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-54540b63-887e-438a-b917-8b2068354348 tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-e62106a2-5353-4f05-baa1-92040eda405d-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:28 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:28 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:28 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.565s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b454bb9b-3ce9-40ce-8e9b-c93d5aeda71b tempest-GroupsTest-2050165492 None] Delete group completed successfully. Sep 25 18:03:28 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.332s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:28 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-50ec4e94-62f5-4a00-8871-dc2034b74906 tempest-GroupsTest-2050165492 None] Delete group completed successfully. Sep 25 18:03:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-18f1680c-9e62-473a-96bd-99274ae1026a-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-18f1680c-9e62-473a-96bd-99274ae1026a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cab3dc-e5c3-4223-9b50-44d8cfc4fb81]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:29 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a Sep 25 18:03:29 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:30 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a" returned: 0 in 0.648s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:30 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a Sep 25 18:03:30 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e6b7c744-2a02-4dfd-b382-4a44b032a00f tempest-GroupsTest-2050165492 None] Group tempest-GroupsTest-Group-1128562198: creating Sep 25 18:03:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e6b7c744-2a02-4dfd-b382-4a44b032a00f tempest-GroupsTest-2050165492 None] Group tempest-GroupsTest-Group-1128562198: created successfully Sep 25 18:03:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e6b7c744-2a02-4dfd-b382-4a44b032a00f tempest-GroupsTest-2050165492 None] Create group completed successfully. Sep 25 18:03:30 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-18f1680c-9e62-473a-96bd-99274ae1026a" returned: 0 in 0.390s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-quobyte-18f1680c-9e62-473a-96bd-99274ae1026a" released by "delete_volume" :: held 1.155s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Created reservations ['42dbcedf-77c5-4b04-85c6-80bff1e52484', '6d8c1a09-9f59-4bcb-8544-18949fd4e442', 'be1abb8b-0fde-47b7-a90b-e29a570e6e29', '854ed60c-382f-46bf-a77e-0b7f609cc12a'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:30 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:30 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:30 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Deleted volume successfully. Sep 25 18:03:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-570a0414-628f-4bb1-a484-1d69ac7a4fba tempest-VolumesSnapshotListTestJSON-1607599671 None] Lock "cinder-18f1680c-9e62-473a-96bd-99274ae1026a-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Flow 'volume_create_manager' (3750e264-98c5-4109-9dd1-5f42239cf5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a332cd83-886f-4415-8f89-63bafe249c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a332cd83-886f-4415-8f89-63bafe249c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-403421680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e71de364-6b89-4bc3-87ec-58c2ce1bdc2b,host='devstack@QuobyteHD#QuobyteHD',id=b22cc4ae-1af7-44f0-89ce-27acd7b57884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649568896604b6184a152954834dabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:32Z,use_quota=True,user_id='0fe6b18dbac8477398616589790f53b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(448c2416-db5a-48e9-a41e-10ff337632fd),volume_type_id=448c2416-db5a-48e9-a41e-10ff337632fd)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1ef832-80d2-481b-b16a-3edf2f80f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1ef832-80d2-481b-b16a-3edf2f80f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bf2976-1bfc-4922-b1c8-ee3f16702200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bf2976-1bfc-4922-b1c8-ee3f16702200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22cc4ae-1af7-44f0-89ce-27acd7b57884', 'volume_name': 'volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28867181-313e-4228-853b-724a3117beab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28867181-313e-4228-853b-724a3117beab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3914c2b-a40e-4f51-a5a7-08b501810dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Volume b22cc4ae-1af7-44f0-89ce-27acd7b57884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884', 'volume_size': 1} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e71de364-6b89-4bc3-87ec-58c2ce1bdc2b,created_at=2026-09-25T16:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-403421680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e71de364-6b89-4bc3-87ec-58c2ce1bdc2b,host='devstack@QuobyteHD#QuobyteHD',id=b22cc4ae-1af7-44f0-89ce-27acd7b57884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649568896604b6184a152954834dabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:32Z,use_quota=True,user_id='0fe6b18dbac8477398616589790f53b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(448c2416-db5a-48e9-a41e-10ff337632fd),volume_type_id=448c2416-db5a-48e9-a41e-10ff337632fd)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Creating volume b22cc4ae-1af7-44f0-89ce-27acd7b57884 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:32 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 1073741824 Sep 25 18:03:32 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:32 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 1073741824" returned: 0 in 0.646s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:33 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 Sep 25 18:03:33 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:33 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884" returned: 0 in 0.314s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3914c2b-a40e-4f51-a5a7-08b501810dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75528585-2629-41da-bfbc-f57d4e1cc122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Volume volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 (b22cc4ae-1af7-44f0-89ce-27acd7b57884): created successfully Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75528585-2629-41da-bfbc-f57d4e1cc122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Flow 'volume_create_manager' (3750e264-98c5-4109-9dd1-5f42239cf5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b47db464-2931-44d0-a8fd-cd0c9c290478 tempest-GroupsTest-2050165492 None] Created volume successfully. Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-82d636e4-5430-4b74-a6a8-76e4d4cbaeb7 tempest-BackendsCapabilitiesAdminTestsJSON-1802315970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2857971191406, 'free_capacity_gb': 1775.2857971191406, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86665) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 18:03:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-df46c55c-ab7a-40fd-975a-eadee641000c tempest-BackendsCapabilitiesAdminTestsJSON-1802315970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2857971191406, 'free_capacity_gb': 1775.2857971191406, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86665) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Flow 'volume_create_manager' (e81e4480-aaf5-4db5-98be-d3fa005e36c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993f309e-3fbe-44af-b76b-a7c792a3b8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993f309e-3fbe-44af-b76b-a7c792a3b8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202549318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e71de364-6b89-4bc3-87ec-58c2ce1bdc2b,host='devstack@QuobyteHD#QuobyteHD',id=741513a3-6e54-4153-86d1-9656ba2a074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649568896604b6184a152954834dabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:34Z,use_quota=True,user_id='0fe6b18dbac8477398616589790f53b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(448c2416-db5a-48e9-a41e-10ff337632fd),volume_type_id=448c2416-db5a-48e9-a41e-10ff337632fd)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e102a-c637-48af-b23a-0e0839304b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e102a-c637-48af-b23a-0e0839304b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634dd187-f263-41db-b85a-5609a3947faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634dd187-f263-41db-b85a-5609a3947faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741513a3-6e54-4153-86d1-9656ba2a074b', 'volume_name': 'volume-741513a3-6e54-4153-86d1-9656ba2a074b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90d9faf-853c-4993-8327-dede5ac1f77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90d9faf-853c-4993-8327-dede5ac1f77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e19c73-3527-4785-98bc-d5b0fbbcb909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Volume 741513a3-6e54-4153-86d1-9656ba2a074b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741513a3-6e54-4153-86d1-9656ba2a074b', 'volume_size': 1} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e71de364-6b89-4bc3-87ec-58c2ce1bdc2b,created_at=2026-09-25T16:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202549318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e71de364-6b89-4bc3-87ec-58c2ce1bdc2b,host='devstack@QuobyteHD#QuobyteHD',id=741513a3-6e54-4153-86d1-9656ba2a074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649568896604b6184a152954834dabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:03:34Z,use_quota=True,user_id='0fe6b18dbac8477398616589790f53b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(448c2416-db5a-48e9-a41e-10ff337632fd),volume_type_id=448c2416-db5a-48e9-a41e-10ff337632fd)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Creating volume 741513a3-6e54-4153-86d1-9656ba2a074b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:03:34 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:03:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:34 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b 1073741824 Sep 25 18:03:34 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:35 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b 1073741824" returned: 0 in 0.506s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:35 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b Sep 25 18:03:35 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:35 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e19c73-3527-4785-98bc-d5b0fbbcb909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741513a3-6e54-4153-86d1-9656ba2a074b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7905be2-a84b-4499-828c-acddfd86fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:03:35 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Volume volume-741513a3-6e54-4153-86d1-9656ba2a074b (741513a3-6e54-4153-86d1-9656ba2a074b): created successfully Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7905be2-a84b-4499-828c-acddfd86fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:03:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Flow 'volume_create_manager' (e81e4480-aaf5-4db5-98be-d3fa005e36c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:03:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4985991e-3892-4141-9b68-692d8acf91b8 tempest-GroupsTest-2050165492 None] Created volume successfully. Sep 25 18:03:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-da76f780-dd71-486f-a697-16d57571f431 tempest-GroupsTest-2050165492 None] Update group completed successfully. Sep 25 18:03:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e5e391de-8fc2-4c2c-aa4a-37eae62c549b tempest-GroupsTest-2050165492 None] Update group completed successfully. Sep 25 18:03:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Acquiring lock "cinder-quobyte-741513a3-6e54-4153-86d1-9656ba2a074b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Lock "cinder-quobyte-741513a3-6e54-4153-86d1-9656ba2a074b" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:40 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5ea32-cb4c-4d14-9098-b6cd6d1cf9ce]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:40 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b Sep 25 18:03:40 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-91227017-6067-4eff-a795-b9ff72487b74 tempest-GroupsV320Test-909394511 None] Group tempest-GroupsV320Test-Group-1678313876: creating Sep 25 18:03:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-91227017-6067-4eff-a795-b9ff72487b74 tempest-GroupsV320Test-909394511 None] Group tempest-GroupsV320Test-Group-1678313876: created successfully Sep 25 18:03:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-91227017-6067-4eff-a795-b9ff72487b74 tempest-GroupsV320Test-909394511 None] Create group completed successfully. Sep 25 18:03:41 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b" returned: 0 in 0.664s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:41 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b Sep 25 18:03:41 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:41 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-741513a3-6e54-4153-86d1-9656ba2a074b" returned: 0 in 0.323s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Lock "cinder-quobyte-741513a3-6e54-4153-86d1-9656ba2a074b" released by "delete_volume" :: held 1.043s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Acquiring lock "cinder-quobyte-b22cc4ae-1af7-44f0-89ce-27acd7b57884" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Lock "cinder-quobyte-b22cc4ae-1af7-44f0-89ce-27acd7b57884" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c7f717-ba76-45af-8afc-1c1a6ddd17a3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:41 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 Sep 25 18:03:41 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:42 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884" returned: 0 in 0.558s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:42 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884 Sep 25 18:03:42 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:42 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b22cc4ae-1af7-44f0-89ce-27acd7b57884" returned: 0 in 0.537s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Lock "cinder-quobyte-b22cc4ae-1af7-44f0-89ce-27acd7b57884" released by "delete_volume" :: held 1.166s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:42 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Created reservations ['53c79902-e6d4-46f5-b2f4-95ce755f83d1'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Created reservations ['3f28288a-2d87-4a6b-8ce0-5d97f258072e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:43 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:43 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:43 devstack cinder-volume[86665]: WARNING cinder.quota [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-746412009 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-746412009, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:03:43 devstack cinder-volume[86665]: WARNING cinder.quota [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-746412009 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-746412009, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Created reservations ['7800fbd8-704f-48fc-9f9b-bc6e7fdb7e54', '8c89af0d-2cc8-413d-ad6f-a61c5d20d962', 'f7cf3d71-ef91-4c24-a3cb-b869f065f770', 'a25f330b-6d58-4b61-95b9-8df03ffa5c8e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Created reservations ['2bfc9671-cd05-4528-b344-6664673158b9', '23835f53-b83f-40c2-89b4-a3504d9ac53f', '6581b443-4450-4444-966e-74058f5bae05', '844bd59d-296c-4a2d-a4ed-708476326414'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:43 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.345s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-73db16ab-3a54-4776-84e9-b6a43f760cfd tempest-GroupsV320Test-909394511 None] Delete group completed successfully. Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:43 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:43 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:43 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:43 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2cebb97c-d3f5-4398-9335-c2664dd40468 tempest-GroupsTest-2050165492 None] Delete group completed successfully. Sep 25 18:03:53 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=79,cinder:INSERT=20,cinder:UPDATE=95,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:03:53 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=75,cinder:INSERT=27,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:55 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:55 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:56 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.391s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:03:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:03:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:03:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-2f6eab1d-05cc-4068-aaaf-bd036d8df15d req-ec0483d9-5a08-40d8-9354-aae6a03dc026 tempest-TestMinimumBasicScenario-1638694043 None] Terminate volume connection completed successfully. Sep 25 18:03:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-2f6eab1d-05cc-4068-aaaf-bd036d8df15d req-ec0483d9-5a08-40d8-9354-aae6a03dc026 tempest-TestMinimumBasicScenario-1638694043 None] Deleting attachment 244670a0-65df-49b0-928d-7ee73d50d3bd. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Acquiring lock "cinder-c9080fd2-8915-4e09-afa4-5e938d1763e5-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Lock "cinder-c9080fd2-8915-4e09-afa4-5e938d1763e5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Acquiring lock "cinder-quobyte-c9080fd2-8915-4e09-afa4-5e938d1763e5" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Lock "cinder-quobyte-c9080fd2-8915-4e09-afa4-5e938d1763e5" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01c37f-ee75-4334-9ab4-c1fb353d2686]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:57 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 Sep 25 18:03:57 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:57 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5" returned: 0 in 0.551s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:58 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5 Sep 25 18:03:58 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:58 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c9080fd2-8915-4e09-afa4-5e938d1763e5" returned: 0 in 0.491s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Lock "cinder-quobyte-c9080fd2-8915-4e09-afa4-5e938d1763e5" released by "delete_volume" :: held 1.145s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Created reservations ['a779b9a2-a7c9-443d-bae8-85ed7aa9ad4f', 'f02e57e0-56c6-410e-b533-9ff05a3398c6', '51fd281c-b64b-4a05-9369-0c0d187b680f', '27e691b1-a563-49bb-9ef4-805d71e74b8e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:03:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:03:58 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:03:58 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:03:59 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 25 18:03:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.386s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:03:59 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:03:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Deleted volume successfully. Sep 25 18:03:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-29693b9a-c87b-45cf-aa73-6fecbdb7439e tempest-TestMinimumBasicScenario-1638694043 None] Lock "cinder-c9080fd2-8915-4e09-afa4-5e938d1763e5-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Flow 'volume_create_manager' (71953d29-38c2-4f06-a249-025c36206a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28c9692-a5b2-4057-af22-38ceda1cde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28c9692-a5b2-4057-af22-38ceda1cde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-121091421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b15a66-7ecc-469f-8cf5-a825770be888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52d34bef1b42959eabce896c9d34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:03Z,use_quota=True,user_id='1b62306f50ef4f0bb76fa2c9403365fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88ae979d-ffa6-4b92-8c78-3d37a67c5e1f),volume_type_id=88ae979d-ffa6-4b92-8c78-3d37a67c5e1f)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f879e6-6030-4ca5-89de-b829c8234c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f879e6-6030-4ca5-89de-b829c8234c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324e37d1-7514-4799-9d89-9112aadfc101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324e37d1-7514-4799-9d89-9112aadfc101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b15a66-7ecc-469f-8cf5-a825770be888', 'volume_name': 'volume-e1b15a66-7ecc-469f-8cf5-a825770be888', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d9acc2-c58a-4a90-8eb2-1ba005342130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d9acc2-c58a-4a90-8eb2-1ba005342130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010254d2-6ad6-4f81-b1c9-82f580e30ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Volume e1b15a66-7ecc-469f-8cf5-a825770be888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b15a66-7ecc-469f-8cf5-a825770be888', 'volume_size': 1} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-121091421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b15a66-7ecc-469f-8cf5-a825770be888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52d34bef1b42959eabce896c9d34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:03Z,use_quota=True,user_id='1b62306f50ef4f0bb76fa2c9403365fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88ae979d-ffa6-4b92-8c78-3d37a67c5e1f),volume_type_id=88ae979d-ffa6-4b92-8c78-3d37a67c5e1f)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Creating volume e1b15a66-7ecc-469f-8cf5-a825770be888 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:02 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:02 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 1073741824 Sep 25 18:04:02 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Flow 'volume_create_manager' (56cf9e47-96c2-4ff8-b30a-4659b4c5d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299d0727-5acc-473c-9064-45dd553e0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299d0727-5acc-473c-9064-45dd553e0b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1267272606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc48cc97-64fc-4b90-a577-5a1186fddac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52d34bef1b42959eabce896c9d34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:03Z,use_quota=True,user_id='1b62306f50ef4f0bb76fa2c9403365fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e40151b-d004-41db-8a3f-7f2d67ead9a8),volume_type_id=5e40151b-d004-41db-8a3f-7f2d67ead9a8)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94ed65d-67fa-458f-9a11-7c2f970d54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94ed65d-67fa-458f-9a11-7c2f970d54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d10e97-650d-4f6e-9e15-8cab0871d058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d10e97-650d-4f6e-9e15-8cab0871d058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc48cc97-64fc-4b90-a577-5a1186fddac8', 'volume_name': 'volume-cc48cc97-64fc-4b90-a577-5a1186fddac8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98141d4d-ca81-4b25-9ac5-9fb5416fb2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98141d4d-ca81-4b25-9ac5-9fb5416fb2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b7c341-fc12-4ac3-8300-34d8ed14bccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:03 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Volume cc48cc97-64fc-4b90-a577-5a1186fddac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc48cc97-64fc-4b90-a577-5a1186fddac8', 'volume_size': 1} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:03 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 1073741824" returned: 0 in 0.822s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:03 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 Sep 25 18:04:03 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:04 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888" returned: 0 in 0.360s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1267272606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc48cc97-64fc-4b90-a577-5a1186fddac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52d34bef1b42959eabce896c9d34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:03Z,use_quota=True,user_id='1b62306f50ef4f0bb76fa2c9403365fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e40151b-d004-41db-8a3f-7f2d67ead9a8),volume_type_id=5e40151b-d004-41db-8a3f-7f2d67ead9a8)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Creating volume cc48cc97-64fc-4b90-a577-5a1186fddac8 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:04 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:04 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 1073741824 Sep 25 18:04:04 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010254d2-6ad6-4f81-b1c9-82f580e30ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b15a66-7ecc-469f-8cf5-a825770be888', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a23013-fe4b-41b7-8372-48f71cf8a921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:04 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Volume volume-e1b15a66-7ecc-469f-8cf5-a825770be888 (e1b15a66-7ecc-469f-8cf5-a825770be888): created successfully Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a23013-fe4b-41b7-8372-48f71cf8a921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Flow 'volume_create_manager' (71953d29-38c2-4f06-a249-025c36206a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:04 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2a6c6321-091a-4cf8-a487-cf5a05092d6b tempest-TestInstancesWithCinderVolumes-379235551 None] Created volume successfully. Sep 25 18:04:04 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Flow 'volume_create_manager' (1eb2672d-ce94-4625-ad9a-77c829300249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:05 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0ce9a8-b76b-4f71-835b-9d6560ad3f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 1073741824" returned: 0 in 0.827s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0ce9a8-b76b-4f71-835b-9d6560ad3f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609262774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa53bb4-94f4-4a21-84d8-9c7b4d034f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52d34bef1b42959eabce896c9d34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:05Z,use_quota=True,user_id='1b62306f50ef4f0bb76fa2c9403365fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98cf34d7-a421-4666-9ca2-90846a266ac2),volume_type_id=98cf34d7-a421-4666-9ca2-90846a266ac2)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80910a0a-d18c-4abe-998e-e2f4b534d230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80910a0a-d18c-4abe-998e-e2f4b534d230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81840ef-457d-448d-ac89-2e44d5a0d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:05 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 Sep 25 18:04:05 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:05 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8" returned: 0 in 0.480s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81840ef-457d-448d-ac89-2e44d5a0d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9aa53bb4-94f4-4a21-84d8-9c7b4d034f11', 'volume_name': 'volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11', 'volume_size': 1, 'image_id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/842bf82c-7e3b-4924-ad6f-29a56a07e486', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--706694702', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f52d34bef1b42959eabce896c9d34e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'created_at': datetime.datetime(2026, 9, 25, 16, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 4, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/842bf82c-7e3b-4924-ad6f-29a56a07e486/file', 'properties': {}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976296db-1896-436a-af19-31a1aa30522b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976296db-1896-436a-af19-31a1aa30522b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f762453e-4d02-49ca-b7f9-ab255beae721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:05 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Volume 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11', 'volume_size': 1, 'image_id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/842bf82c-7e3b-4924-ad6f-29a56a07e486', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--706694702', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f52d34bef1b42959eabce896c9d34e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'created_at': datetime.datetime(2026, 9, 25, 16, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 4, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/842bf82c-7e3b-4924-ad6f-29a56a07e486/file', 'properties': {}}, 'image_service': } Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Trying to clone 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 from image 842bf82c-7e3b-4924-ad6f-29a56a07e486 at location (None, [{'url': 'file:///opt/stack/data/glance/images/842bf82c-7e3b-4924-ad6f-29a56a07e486', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b7c341-fc12-4ac3-8300-34d8ed14bccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc48cc97-64fc-4b90-a577-5a1186fddac8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba55dc-d775-497e-a9a8-28783f4e7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:05 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Volume volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 (cc48cc97-64fc-4b90-a577-5a1186fddac8): created successfully Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba55dc-d775-497e-a9a8-28783f4e7438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Flow 'volume_create_manager' (56cf9e47-96c2-4ff8-b30a-4659b4c5d186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c7e14da6-589d-4aec-87b6-4c98ea785e12 tempest-TestInstancesWithCinderVolumes-379235551 None] Created volume successfully. Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD, size 20.69 MB, duration 4.56 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:04:10 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Image download 20.69 MB at 4.53 MB/s Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d09cbe7-e0dd-474c-82d9-646fe63f15ef]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:10 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD Sep 25 18:04:10 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:10 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Temporary image 842bf82c-7e3b-4924-ad6f-29a56a07e486 is fetched for user 1b62306f50ef4f0bb76fa2c9403365fd. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f906df15-5184-4b63-8b27-85b8e1d860d9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:10 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD Sep 25 18:04:10 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:11 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609262774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa53bb4-94f4-4a21-84d8-9c7b4d034f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52d34bef1b42959eabce896c9d34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:05Z,use_quota=True,user_id='1b62306f50ef4f0bb76fa2c9403365fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98cf34d7-a421-4666-9ca2-90846a266ac2),volume_type_id=98cf34d7-a421-4666-9ca2-90846a266ac2)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Creating volume 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:11 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:11 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 1073741824 Sep 25 18:04:11 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:11 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 1073741824" returned: 0 in 0.598s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:11 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 Sep 25 18:04:11 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:12 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" returned: 0 in 0.375s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Attempting download of 842bf82c-7e3b-4924-ad6f-29a56a07e486 ((None, [{'url': 'file:///opt/stack/data/glance/images/842bf82c-7e3b-4924-ad6f-29a56a07e486', 'metadata': {}}])) to volume 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4c35ce-da1b-44d2-a57c-fca928ff2ac8]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:12 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni Sep 25 18:04:12 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:12 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni" returned: 0 in 0.441s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:12 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni Sep 25 18:04:12 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:13 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni" returned: 1 in 0.421s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_842bf82c-7e3b-4924-ad6f-29a56a07e486_j7g14vni' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4300e-2b7e-43f6-a46f-b381790445bf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:13 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD Sep 25 18:04:13 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:13 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] 842bf82c-7e3b-4924-ad6f-29a56a07e486 was qcow2, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:04:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:13 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 Sep 25 18:04:13 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Flow 'volume_create_manager' (e290368a-8ae9-4ebf-abac-cbf752e5e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b46dd7b-c99a-4778-b78d-230f3a3af202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b46dd7b-c99a-4778-b78d-230f3a3af202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1685543725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7eeae1-300b-435e-8bde-960c4db8b77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38aff7fabde74d27bfafda73c2b37ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:15Z,use_quota=True,user_id='2c56cddcb64d46c0967832fc0f779546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d099ed13-34b3-4648-9cf6-efb5dc8371da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d099ed13-34b3-4648-9cf6-efb5dc8371da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758d7139-1113-44f4-a896-cbcdd2a318cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758d7139-1113-44f4-a896-cbcdd2a318cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7eeae1-300b-435e-8bde-960c4db8b77c', 'volume_name': 'volume-ea7eeae1-300b-435e-8bde-960c4db8b77c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfad69e1-0330-4597-9835-a60fd51e24b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfad69e1-0330-4597-9835-a60fd51e24b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc5af4-8e84-4fbf-962f-264239abbf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:14 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Volume ea7eeae1-300b-435e-8bde-960c4db8b77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7eeae1-300b-435e-8bde-960c4db8b77c', 'volume_size': 1} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1685543725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7eeae1-300b-435e-8bde-960c4db8b77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38aff7fabde74d27bfafda73c2b37ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:15Z,use_quota=True,user_id='2c56cddcb64d46c0967832fc0f779546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Creating volume ea7eeae1-300b-435e-8bde-960c4db8b77c {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:15 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:15 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c 1073741824 Sep 25 18:04:15 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:15 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c 1073741824" returned: 0 in 0.740s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:15 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c Sep 25 18:04:15 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:16 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c" returned: 0 in 0.353s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc5af4-8e84-4fbf-962f-264239abbf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7eeae1-300b-435e-8bde-960c4db8b77c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1474e134-5a42-4e81-960b-a82beb86f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:16 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Volume volume-ea7eeae1-300b-435e-8bde-960c4db8b77c (ea7eeae1-300b-435e-8bde-960c4db8b77c): created successfully Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1474e134-5a42-4e81-960b-a82beb86f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Flow 'volume_create_manager' (e290368a-8ae9-4ebf-abac-cbf752e5e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fcc45107-935d-4d09-a79d-537abb0fdaeb tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Created volume successfully. Sep 25 18:04:16 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" returned: 0 in 2.611s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_842bf82c-7e3b-4924-ad6f-29a56a07e486_ostacvpidevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:04:16 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Converted 112.00 MB image at 42.88 MB/s Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:16 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 1G Sep 25 18:04:16 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:16 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 1G" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Downloaded image 842bf82c-7e3b-4924-ad6f-29a56a07e486 ((None, [{'url': 'file:///opt/stack/data/glance/images/842bf82c-7e3b-4924-ad6f-29a56a07e486', 'metadata': {}}])) to volume 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Temporary image 842bf82c-7e3b-4924-ad6f-29a56a07e486 for user 1b62306f50ef4f0bb76fa2c9403365fd is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Marking volume 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Copying metadata from image 842bf82c-7e3b-4924-ad6f-29a56a07e486 to 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Creating volume glance metadata for volume 9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 backed by image 842bf82c-7e3b-4924-ad6f-29a56a07e486 with: {'image_id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'image_name': 'tempest-scenario-img--706694702', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f762453e-4d02-49ca-b7f9-ab255beae721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11', 'volume_size': 1, 'image_id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/842bf82c-7e3b-4924-ad6f-29a56a07e486', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--706694702', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f52d34bef1b42959eabce896c9d34e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '842bf82c-7e3b-4924-ad6f-29a56a07e486', 'created_at': datetime.datetime(2026, 9, 25, 16, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 4, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/842bf82c-7e3b-4924-ad6f-29a56a07e486/file', 'properties': {}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1aad73-cdd0-4494-97f9-8d242bb047c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:16 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Volume volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 (9aa53bb4-94f4-4a21-84d8-9c7b4d034f11): created successfully Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1aad73-cdd0-4494-97f9-8d242bb047c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:16 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Flow 'volume_create_manager' (1eb2672d-ce94-4625-ad9a-77c829300249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d7812f3e-96a2-46b6-bab0-072068b58416 tempest-TestInstancesWithCinderVolumes-379235551 None] Created volume successfully. Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Flow 'volume_create_manager' (e07c90e6-62c6-4c5c-a5d8-08c01febd96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0d19e0-af30-4181-8bba-d627698f4448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0d19e0-af30-4181-8bba-d627698f4448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-723373928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72bbcde-98e5-498a-8ed4-1f86b552b7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80311fae11d34a47a1e3dd2031f1e428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:18Z,use_quota=True,user_id='b8e07304611845b6a7c0170ec78b807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b324ed-f050-4b8f-8f0d-cd641fa8a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b324ed-f050-4b8f-8f0d-cd641fa8a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71200b32-04bb-4b7f-a61e-bd5105d51d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71200b32-04bb-4b7f-a61e-bd5105d51d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72bbcde-98e5-498a-8ed4-1f86b552b7da', 'volume_name': 'volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d245e967-d6cb-475e-b211-16589726be17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d245e967-d6cb-475e-b211-16589726be17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8abb6c-479e-4667-b0c9-52b55f07aa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:18 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Volume c72bbcde-98e5-498a-8ed4-1f86b552b7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da', 'volume_size': 1} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-723373928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72bbcde-98e5-498a-8ed4-1f86b552b7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80311fae11d34a47a1e3dd2031f1e428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:18Z,use_quota=True,user_id='b8e07304611845b6a7c0170ec78b807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Creating volume c72bbcde-98e5-498a-8ed4-1f86b552b7da {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:18 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:18 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da 1073741824 Sep 25 18:04:18 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Acquiring lock "cinder-ea7eeae1-300b-435e-8bde-960c4db8b77c-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "cinder-ea7eeae1-300b-435e-8bde-960c4db8b77c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Acquiring lock "cinder-quobyte-ea7eeae1-300b-435e-8bde-960c4db8b77c" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "cinder-quobyte-ea7eeae1-300b-435e-8bde-960c4db8b77c" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3b2e8b-9660-493b-810b-1b998f78cb06]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:18 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c Sep 25 18:04:18 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:18 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da 1073741824" returned: 0 in 0.624s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:18 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da Sep 25 18:04:18 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:19 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c" returned: 0 in 0.584s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:19 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c Sep 25 18:04:19 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:19 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da" returned: 0 in 0.353s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8abb6c-479e-4667-b0c9-52b55f07aa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db3f550-7916-49bd-b305-abd5fbf0da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Volume volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da (c72bbcde-98e5-498a-8ed4-1f86b552b7da): created successfully Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db3f550-7916-49bd-b305-abd5fbf0da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Flow 'volume_create_manager' (e07c90e6-62c6-4c5c-a5d8-08c01febd96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-69c4c335-91ed-468e-b8c6-bc4b3cec8ed2 tempest-VolumesServicesTestJSON-350452134 None] Created volume successfully. Sep 25 18:04:19 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea7eeae1-300b-435e-8bde-960c4db8b77c" returned: 0 in 0.314s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "cinder-quobyte-ea7eeae1-300b-435e-8bde-960c4db8b77c" released by "delete_volume" :: held 0.953s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Created reservations ['21396a6d-a7d2-4832-88bb-b9e7b214c03c', '95e076a2-8b0c-4a13-8393-79b4ad9442af', 'aa1f006f-931e-49ea-be8f-dd78451337a8', 'd104a855-a68a-492a-b52c-bb30052b7cd5'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:19 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:04:19 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:19 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.344s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:04:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Deleted volume successfully. Sep 25 18:04:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-413b1e9d-1730-4d98-8c01-ea3c5b8a4a26 tempest-VolumeQuotasNegativeTestJSON-1801411913 None] Lock "cinder-ea7eeae1-300b-435e-8bde-960c4db8b77c-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Acquiring lock "cinder-c72bbcde-98e5-498a-8ed4-1f86b552b7da-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:04:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Lock "cinder-c72bbcde-98e5-498a-8ed4-1f86b552b7da-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:04:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Acquiring lock "cinder-quobyte-c72bbcde-98e5-498a-8ed4-1f86b552b7da" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:04:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Lock "cinder-quobyte-c72bbcde-98e5-498a-8ed4-1f86b552b7da" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:04:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8060ee85-f063-4852-bf21-5a1fe206c0fd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:20 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da Sep 25 18:04:20 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-9d9177b9-2f43-429e-b2f7-a938842551cd req-0abc476d-5e5c-4019-9270-797da1084d55 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-9d9177b9-2f43-429e-b2f7-a938842551cd req-0abc476d-5e5c-4019-9270-797da1084d55 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-9d9177b9-2f43-429e-b2f7-a938842551cd req-0abc476d-5e5c-4019-9270-797da1084d55 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-9d9177b9-2f43-429e-b2f7-a938842551cd req-0abc476d-5e5c-4019-9270-797da1084d55 tempest-TestInstancesWithCinderVolumes-379235551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74076e33-11ee-40a9-974e-9a1b0fb39bb3', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:04:21 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da" returned: 0 in 0.693s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-9d9177b9-2f43-429e-b2f7-a938842551cd req-0abc476d-5e5c-4019-9270-797da1084d55 tempest-TestInstancesWithCinderVolumes-379235551 None] attachment_update completed successfully. Sep 25 18:04:21 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da Sep 25 18:04:21 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:21 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c72bbcde-98e5-498a-8ed4-1f86b552b7da" returned: 0 in 0.366s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Lock "cinder-quobyte-c72bbcde-98e5-498a-8ed4-1f86b552b7da" released by "delete_volume" :: held 1.129s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Created reservations ['6d6d7af4-828f-4dcf-9e44-72e6298b9421', 'b5c30785-2f7e-494b-b42c-3f53b0c09975', '572524a8-cdbf-4861-9d66-4c1c57bd5039', '24ca208a-d7e9-4116-a2dd-43ae106e63ee'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:21 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:04:21 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:22 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:22 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:04:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Deleted volume successfully. Sep 25 18:04:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-63fc2b49-f5b1-4932-b16e-d0034a8f3887 tempest-VolumesServicesTestJSON-350452134 None] Lock "cinder-c72bbcde-98e5-498a-8ed4-1f86b552b7da-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:32 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=37,cinder:UPDATE=37,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:04:32 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=40,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Flow 'volume_create_manager' (399f966f-f415-4476-b3b6-f6ba76d73fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d0e19-f235-46a9-a511-a5b201fd7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d0e19-f235-46a9-a511-a5b201fd7342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1327186500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cfbcdf-82c7-4e7f-a189-a62ba4760829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0e5dcd3dfe46ca89a59afba0639f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:45Z,use_quota=True,user_id='cede77543cac476f9bf6197cffb06849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9093f9f5-e2ea-49cd-8ba4-7cdd9d2e7a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9093f9f5-e2ea-49cd-8ba4-7cdd9d2e7a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e075ea-9a37-4e34-9526-7295ae733ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:44 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e075ea-9a37-4e34-9526-7295ae733ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6cfbcdf-82c7-4e7f-a189-a62ba4760829', 'volume_name': 'volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c56ea4-be4b-43d6-a528-22d624142169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c56ea4-be4b-43d6-a528-22d624142169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de3c195-48aa-4670-9014-de9ef0c69077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:45 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Volume a6cfbcdf-82c7-4e7f-a189-a62ba4760829: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Trying to clone a6cfbcdf-82c7-4e7f-a189-a62ba4760829 from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:04:45 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Image download 20.69 MB at 20.69 MB/s Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f2e97a-8589-41c5-913f-a643d7d30fe0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:46 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD Sep 25 18:04:46 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:46 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD" returned: 0 in 0.580s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:46 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 is fetched for user cede77543cac476f9bf6197cffb06849. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:04:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c685cc7b-0837-40d7-8c65-db2ef1714004]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:46 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD Sep 25 18:04:46 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:47 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD" returned: 0 in 0.490s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1327186500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cfbcdf-82c7-4e7f-a189-a62ba4760829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0e5dcd3dfe46ca89a59afba0639f04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:45Z,use_quota=True,user_id='cede77543cac476f9bf6197cffb06849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Creating volume a6cfbcdf-82c7-4e7f-a189-a62ba4760829 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:47 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:47 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 1073741824 Sep 25 18:04:47 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:48 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 1073741824" returned: 0 in 0.818s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:48 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 Sep 25 18:04:48 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:48 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" returned: 0 in 0.580s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Attempting download of cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume a6cfbcdf-82c7-4e7f-a189-a62ba4760829. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Flow 'volume_create_manager' (63abb633-6fb9-4dc7-992e-894a3c9011b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4554e251-143f-4277-aff1-1e374a312f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4554e251-143f-4277-aff1-1e374a312f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1880475187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8287f121-5478-4069-928b-0c5780694164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a084c7dab0426cafcf5e7f04178d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:49Z,use_quota=True,user_id='4e768e65b6244002af6621bb0dbfbd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe93d811-e519-4824-956a-2b11a3be174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe93d811-e519-4824-956a-2b11a3be174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f11c00-1083-4580-bed0-0b8076b18398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f11c00-1083-4580-bed0-0b8076b18398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8287f121-5478-4069-928b-0c5780694164', 'volume_name': 'volume-8287f121-5478-4069-928b-0c5780694164', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f2ba2-68ac-47bc-ab55-7b5725f52b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f2ba2-68ac-47bc-ab55-7b5725f52b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d624c83-33ab-447a-8bf0-4a746f5ba33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:48 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Volume 8287f121-5478-4069-928b-0c5780694164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8287f121-5478-4069-928b-0c5780694164', 'volume_size': 1} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1880475187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8287f121-5478-4069-928b-0c5780694164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a084c7dab0426cafcf5e7f04178d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:49Z,use_quota=True,user_id='4e768e65b6244002af6621bb0dbfbd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Creating volume 8287f121-5478-4069-928b-0c5780694164 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:49 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:49 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 1073741824 Sep 25 18:04:49 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8be385-b78a-464c-b2a9-834d8122979d]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:49 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7 Sep 25 18:04:49 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:49 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7" returned: 0 in 0.631s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:50 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7 Sep 25 18:04:50 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Flow 'volume_create_manager' (41a1c302-84ea-44f5-a666-dbe5ec85ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed107abe-5b0f-471c-8489-6a34e5466044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed107abe-5b0f-471c-8489-6a34e5466044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1413786544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726bb16a-043e-4c24-b58c-41bf16b336ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a084c7dab0426cafcf5e7f04178d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:50Z,use_quota=True,user_id='4e768e65b6244002af6621bb0dbfbd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35300f9-aeab-4c96-a355-168907c4670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35300f9-aeab-4c96-a355-168907c4670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fe0584-6485-4b1d-a7a6-0c7eba63a96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fe0584-6485-4b1d-a7a6-0c7eba63a96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726bb16a-043e-4c24-b58c-41bf16b336ad', 'volume_name': 'volume-726bb16a-043e-4c24-b58c-41bf16b336ad', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f6571-94f3-4d5e-acce-84518368c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f6571-94f3-4d5e-acce-84518368c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:50 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54ede2e-43e2-4f7f-808f-0aeab7a85327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Volume 726bb16a-043e-4c24-b58c-41bf16b336ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726bb16a-043e-4c24-b58c-41bf16b336ad', 'volume_size': 1} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 1073741824" returned: 0 in 1.240s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:50 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 Sep 25 18:04:50 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:50 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7" returned: 1 in 0.651s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_5qnuh3j7' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b1f6a5-6e5b-4332-8f45-36973ac75afd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:50 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD Sep 25 18:04:50 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:50 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164" returned: 0 in 0.477s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1413786544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726bb16a-043e-4c24-b58c-41bf16b336ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a084c7dab0426cafcf5e7f04178d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:50Z,use_quota=True,user_id='4e768e65b6244002af6621bb0dbfbd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Creating volume 726bb16a-043e-4c24-b58c-41bf16b336ad {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:50 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d624c83-33ab-447a-8bf0-4a746f5ba33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8287f121-5478-4069-928b-0c5780694164', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd59d9f-71a3-4f4b-9702-1a785e39fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:50 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad 1073741824 Sep 25 18:04:50 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Volume volume-8287f121-5478-4069-928b-0c5780694164 (8287f121-5478-4069-928b-0c5780694164): created successfully Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd59d9f-71a3-4f4b-9702-1a785e39fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Flow 'volume_create_manager' (63abb633-6fb9-4dc7-992e-894a3c9011b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a417b6cf-afd5-4e29-a8e5-ac9b9e44fc09 tempest-TestServerVolumeAttachmentScenario-368996325 None] Created volume successfully. Sep 25 18:04:50 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:51 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 was qcow2, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:04:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:51 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 Sep 25 18:04:51 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:51 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad 1073741824" returned: 0 in 0.821s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:51 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad Sep 25 18:04:51 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:52 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad" returned: 0 in 0.439s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54ede2e-43e2-4f7f-808f-0aeab7a85327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726bb16a-043e-4c24-b58c-41bf16b336ad', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce13ec2-7847-4d34-9513-fcfc4657ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Volume volume-726bb16a-043e-4c24-b58c-41bf16b336ad (726bb16a-043e-4c24-b58c-41bf16b336ad): created successfully Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce13ec2-7847-4d34-9513-fcfc4657ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Flow 'volume_create_manager' (41a1c302-84ea-44f5-a666-dbe5ec85ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f9ad7bf1-ab4e-44ff-81c5-9e694498d434 tempest-TestServerVolumeAttachmentScenario-368996325 None] Created volume successfully. Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Flow 'volume_create_manager' (dcd68a67-e267-4948-a1b4-728fb3493bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19e1c39-b683-4734-9767-9e07d4108053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19e1c39-b683-4734-9767-9e07d4108053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-303781653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf47d80b-e942-4c7f-9dbf-ab750facd1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f1d15552649ccb2ab80c80c7c247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:53Z,use_quota=True,user_id='8a66f32baad942a39ea4edb8dfd5d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5820a6-e29d-46a8-af54-a2d9c3857491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5820a6-e29d-46a8-af54-a2d9c3857491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190b2dbd-debb-43b2-82aa-e5f7e8d130d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190b2dbd-debb-43b2-82aa-e5f7e8d130d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf47d80b-e942-4c7f-9dbf-ab750facd1d4', 'volume_name': 'volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a215e277-8097-45cf-858c-94112132eca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a215e277-8097-45cf-858c-94112132eca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91da9ccf-0f84-419c-9f88-10143415ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Volume cf47d80b-e942-4c7f-9dbf-ab750facd1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4', 'volume_size': 1} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-303781653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf47d80b-e942-4c7f-9dbf-ab750facd1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f1d15552649ccb2ab80c80c7c247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:04:53Z,use_quota=True,user_id='8a66f32baad942a39ea4edb8dfd5d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Creating volume cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:04:52 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:04:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:53 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 1073741824 Sep 25 18:04:53 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:53 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 1073741824" returned: 0 in 0.733s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:53 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:04:53 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:54 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91da9ccf-0f84-419c-9f88-10143415ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4a1a40-4804-4ccc-b3ec-f87df48a2168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:54 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Volume volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 (cf47d80b-e942-4c7f-9dbf-ab750facd1d4): created successfully Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4a1a40-4804-4ccc-b3ec-f87df48a2168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Flow 'volume_create_manager' (dcd68a67-e267-4948-a1b4-728fb3493bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7c631ed4-1251-4d08-912d-549f74f3f147 tempest-VolumesDeleteCascade-369989219 None] Created volume successfully. Sep 25 18:04:54 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" returned: 0 in 3.205s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_i3axdaj_devstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:04:54 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Converted 112.00 MB image at 34.93 MB/s Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:54 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 1G Sep 25 18:04:54 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:54 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 1G" returned: 0 in 0.338s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Downloaded image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume a6cfbcdf-82c7-4e7f-a189-a62ba4760829 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 for user cede77543cac476f9bf6197cffb06849 is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Marking volume a6cfbcdf-82c7-4e7f-a189-a62ba4760829 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Copying metadata from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 to a6cfbcdf-82c7-4e7f-a189-a62ba4760829. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Creating volume glance metadata for volume a6cfbcdf-82c7-4e7f-a189-a62ba4760829 backed by image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de3c195-48aa-4670-9014-de9ef0c69077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60381464-92f2-4f1a-8e94-097e4b64a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:04:54 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Volume volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 (a6cfbcdf-82c7-4e7f-a189-a62ba4760829): created successfully Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60381464-92f2-4f1a-8e94-097e4b64a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:04:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Flow 'volume_create_manager' (399f966f-f415-4476-b3b6-f6ba76d73fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:04:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3414674f-f0dc-407b-b840-ccc696ee5f33 tempest-VolumesImageMetadata-1545890804 None] Created volume successfully. Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Creating offline snapshot 2830fe44-85d4-4bc2-9fdc-27d5abc61bef of volume cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd087c-16d9-4e04-8704-20fbd87a4d2e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:55 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:04:55 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:55 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.391s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:55 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef 1G Sep 25 18:04:55 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:55 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:04:55 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:56 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef 1G" returned: 0 in 0.663s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:56 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:04:56 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:04:56 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Acquiring lock "cinder-a6cfbcdf-82c7-4e7f-a189-a62ba4760829-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Lock "cinder-a6cfbcdf-82c7-4e7f-a189-a62ba4760829-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Acquiring lock "cinder-quobyte-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Lock "cinder-quobyte-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[75da0ed9-9300-4e29-be32-b15d5ce55839]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:56 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:56 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.419s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:56 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef is being set with open permissions: ugo+rw Sep 25 18:04:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:56 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:56 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:04:56 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:56 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" returned: 0 in 0.436s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:57 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:57 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829 Sep 25 18:04:57 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:57 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info Sep 25 18:04:57 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:57 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" returned: 0 in 0.401s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Lock "cinder-quobyte-a6cfbcdf-82c7-4e7f-a189-a62ba4760829" released by "delete_volume" :: held 0.899s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:57 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info" returned: 0 in 0.348s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:57 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info is being set with open permissions: ugo+rw Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:57 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info Sep 25 18:04:57 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Created reservations ['8cc688fe-2dba-44b4-9977-8df770777463', 'd133574b-b085-476f-b4c1-7cb98ede4c8d', '65b06b60-14e0-46c6-8f1d-e307f6559c12', 'ec12ae72-035b-4b96-8a04-62ed17c378a3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:57 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:04:57 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:57 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.info" returned: 0 in 0.297s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:04:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e55a5061-aeca-4cfc-92c3-7b674c4be759 tempest-VolumesDeleteCascade-369989219 None] Create snapshot completed successfully Sep 25 18:04:57 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.259s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:04:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Deleted volume successfully. Sep 25 18:04:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ebee8c9e-2b9a-4f6c-a2f5-33a40dadc60e tempest-VolumesImageMetadata-1545890804 None] Lock "cinder-a6cfbcdf-82c7-4e7f-a189-a62ba4760829-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:04:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:04:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:04:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Creating offline snapshot db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb of volume cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:04:58 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8434b06-99f2-4606-84de-329d6554bce5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:04:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:58 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:04:58 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:04:59 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 25 18:04:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.567s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:04:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:04:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:04:59 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb 1G Sep 25 18:04:59 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:00 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb 1G" returned: 0 in 0.974s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:00 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb Sep 25 18:05:00 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:00 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" returned: 0 in 0.517s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:00 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb is being set with open permissions: ugo+rw Sep 25 18:05:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:00 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb Sep 25 18:05:00 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:01 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-973c3f0b-aabc-432f-8472-67f373457f78 tempest-VolumesDeleteCascade-369989219 None] Create snapshot completed successfully Sep 25 18:05:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-cf47d80b-e942-4c7f-9dbf-ab750facd1d4-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-cf47d80b-e942-4c7f-9dbf-ab750facd1d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Performing cascade delete. {{(pid=86665) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-2830fe44-85d4-4bc2-9fdc-27d5abc61bef-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-2830fe44-85d4-4bc2-9fdc-27d5abc61bef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-2830fe44-85d4-4bc2-9fdc-27d5abc61bef" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-2830fe44-85d4-4bc2-9fdc-27d5abc61bef" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Deleting offline snapshot 2830fe44-85d4-4bc2-9fdc-27d5abc61bef of volume cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] snapshot_file for this snap is: volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f3d0e9-260d-4151-b742-6158e2230cde]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:02 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:05:02 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:02 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.653s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f09dfd-1b0d-43be-9343-c3cdf0ddb96b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:03 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:05:03 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:03 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.700s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:03 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9595a7e9-f011-4839-bb80-eac1afa95ba2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:04 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb Sep 25 18:05:04 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:04 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" returned: 0 in 0.652s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:04 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbadeef-c123-4edd-8882-d83e1a8ed2fc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:04 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:05:04 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:05 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.608s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:05 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c4b2a4-6b74-4363-ab82-d38dcb75096a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:05 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:05:05 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:05 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.507s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:05 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:05:05 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:06 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.525s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:06 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef Sep 25 18:05:06 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:06 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.2830fe44-85d4-4bc2-9fdc-27d5abc61bef" returned: 0 in 0.370s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb -F qcow2 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:06 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb -F qcow2 Sep 25 18:05:06 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:06 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb -F qcow2" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-2830fe44-85d4-4bc2-9fdc-27d5abc61bef" released by "_delete_snapshot" :: held 4.717s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" released by "delete_snapshot" :: held 4.762s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:06 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Created reservations ['be9b268d-a55f-4471-9ba9-12a554c8426a', 'f3b59950-edee-4245-88a8-7d8200d285ad', 'd2c5cc46-ebca-44dc-9108-2e2272498a5c', '2d14afd1-27e9-4d5d-b8c0-a92a2ded1cd2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Delete snapshot completed successfully. Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-2830fe44-85d4-4bc2-9fdc-27d5abc61bef-delete_snapshot" released by "delete_snapshot" :: held 4.979s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Deleting offline snapshot db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb of volume cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] snapshot_file for this snap is: volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a37c25-bce8-4609-a54b-aaff9dc3c7d8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:07 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb Sep 25 18:05:07 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Flow 'volume_create_manager' (5824bd15-67f7-4dee-99cc-8e3df04e1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12763f7-b126-449e-85a6-36de9858ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:07 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" returned: 0 in 0.531s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12763f7-b126-449e-85a6-36de9858ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1601769939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea26129f-1820-4b8e-a9b2-5508cbe18a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f40bfe96344c97941d79d5084eb775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:08Z,use_quota=True,user_id='24a6530888af4d0abfb52fa78a9575ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bb7523-3bac-43c9-8054-3b58e4696687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bb7523-3bac-43c9-8054-3b58e4696687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6446fb-d02e-47ac-b4e5-3e3582632e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6446fb-d02e-47ac-b4e5-3e3582632e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea26129f-1820-4b8e-a9b2-5508cbe18a69', 'volume_name': 'volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec39593-86cc-4a2b-827d-3c63362df377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec39593-86cc-4a2b-827d-3c63362df377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9467eb-6355-4f08-8917-cbb9afcc2408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Volume ea26129f-1820-4b8e-a9b2-5508cbe18a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69', 'volume_size': 1} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1601769939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea26129f-1820-4b8e-a9b2-5508cbe18a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f40bfe96344c97941d79d5084eb775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:08Z,use_quota=True,user_id='24a6530888af4d0abfb52fa78a9575ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Creating volume ea26129f-1820-4b8e-a9b2-5508cbe18a69 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:07 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a7c73-eb7b-492e-9857-3c3bcf4a0441]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:07 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 1073741824 Sep 25 18:05:07 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:07 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:05:07 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:08 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 1073741824" returned: 0 in 0.571s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:08 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.612s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:08 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 Sep 25 18:05:08 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:08 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb Sep 25 18:05:08 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-226f20f4-5c54-4b8e-b077-b4b1f1be7a57 req-8c9ded5c-72d3-492c-a45b-71c04f1e8391 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:08 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69" returned: 0 in 0.346s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-226f20f4-5c54-4b8e-b077-b4b1f1be7a57 req-8c9ded5c-72d3-492c-a45b-71c04f1e8391 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.137s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9467eb-6355-4f08-8917-cbb9afcc2408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35096d5c-585c-448c-9661-8efcab3b26c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-226f20f4-5c54-4b8e-b077-b4b1f1be7a57 req-8c9ded5c-72d3-492c-a45b-71c04f1e8391 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Volume volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 (ea26129f-1820-4b8e-a9b2-5508cbe18a69): created successfully Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35096d5c-585c-448c-9661-8efcab3b26c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Flow 'volume_create_manager' (5824bd15-67f7-4dee-99cc-8e3df04e1f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dcc253c3-faa6-4aaa-b0c0-4f2a4d941031 tempest-VolumesTransfersTest-996481135 None] Created volume successfully. Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-226f20f4-5c54-4b8e-b077-b4b1f1be7a57 req-8c9ded5c-72d3-492c-a45b-71c04f1e8391 tempest-TestInstancesWithCinderVolumes-379235551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-e1b15a66-7ecc-469f-8cf5-a825770be888', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '000460aa-17db-4711-a967-bcac08dd2466', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:05:08 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" returned: 0 in 0.436s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:08 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb Sep 25 18:05:08 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-226f20f4-5c54-4b8e-b077-b4b1f1be7a57 req-8c9ded5c-72d3-492c-a45b-71c04f1e8391 tempest-TestInstancesWithCinderVolumes-379235551 None] attachment_update completed successfully. Sep 25 18:05:09 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4.db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" returned: 0 in 0.305s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb" released by "_delete_snapshot" :: held 2.051s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" released by "delete_snapshot" :: held 2.078s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Created reservations ['747bfccb-41ad-4a23-a797-963617324bca', '79b9db48-7c07-49e7-b72c-105b051c127f', '994f19d2-7b72-4dcd-99e7-755f2ebe5e1f', '717425ec-98dd-49b3-9d01-3c00416f09d3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Delete snapshot completed successfully. Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-db4d6a12-0cbf-4c2f-9cc3-42f8ec88f2cb-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Snapshots deleted, issuing volume delete {{(pid=86665) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[641c432b-0844-4399-878c-0b201e2bad4a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:09 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:05:09 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:09 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.537s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:10 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4 Sep 25 18:05:10 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:10 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" returned: 0 in 0.286s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-cf47d80b-e942-4c7f-9dbf-ab750facd1d4" released by "delete_volume" :: held 0.910s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Created reservations ['c7a7d778-914b-4412-aebc-ba03dd466034', '14bc5304-92d1-4480-bfd5-be9bc9d9c58b', '526e4350-49a6-46cb-ba42-4a5fcf2774ba', '84da63d2-303a-4f8a-9528-b3f533b8c73f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:10 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:10 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7d892d04-697b-4860-903e-26f7d4e6310b tempest-VolumesTransfersTest-469093564 None] Transfer volume completed successfully. Sep 25 18:05:10 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.315s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Deleted volume successfully. Sep 25 18:05:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb21ae6d-e524-450a-ad0a-09796f86e442 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-cf47d80b-e942-4c7f-9dbf-ab750facd1d4-delete_volume" released by "delete_volume" :: held 8.896s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Acquiring lock "cinder-ea26129f-1820-4b8e-a9b2-5508cbe18a69-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-ea26129f-1820-4b8e-a9b2-5508cbe18a69-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Acquiring lock "cinder-quobyte-ea26129f-1820-4b8e-a9b2-5508cbe18a69" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-quobyte-ea26129f-1820-4b8e-a9b2-5508cbe18a69" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c20f01-1293-491b-b573-7169f31341b2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:11 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 Sep 25 18:05:11 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:12 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69" returned: 0 in 0.580s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:12 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69 Sep 25 18:05:12 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Flow 'volume_create_manager' (e0d3d49a-6547-4d61-a672-ac29a4af79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99010df-b59e-4acd-ac0e-588cd53f4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99010df-b59e-4acd-ac0e-588cd53f4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-190297974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f5a9f3-c033-44bd-9646-8b7a0d10d16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f1d15552649ccb2ab80c80c7c247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:12Z,use_quota=True,user_id='8a66f32baad942a39ea4edb8dfd5d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b88c59d-d8cb-446f-9109-0b6eeeb7a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b88c59d-d8cb-446f-9109-0b6eeeb7a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebae28e-156a-4d10-ba9e-6a6aa19723de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebae28e-156a-4d10-ba9e-6a6aa19723de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f5a9f3-c033-44bd-9646-8b7a0d10d16f', 'volume_name': 'volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412936bd-2a86-4543-b3c9-5cb60cb107ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412936bd-2a86-4543-b3c9-5cb60cb107ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c70290-acb6-409c-b078-581cc96844bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Volume e6f5a9f3-c033-44bd-9646-8b7a0d10d16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f', 'volume_size': 1} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-190297974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f5a9f3-c033-44bd-9646-8b7a0d10d16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f1d15552649ccb2ab80c80c7c247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:12Z,use_quota=True,user_id='8a66f32baad942a39ea4edb8dfd5d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Creating volume e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:12 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-abf82fe7-07f5-4867-9a32-569788cc8e30 req-19cf3bd5-d0c9-45c9-b24d-800381757236 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:12 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f 1073741824 Sep 25 18:05:12 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:12 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ea26129f-1820-4b8e-a9b2-5508cbe18a69" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-quobyte-ea26129f-1820-4b8e-a9b2-5508cbe18a69" released by "delete_volume" :: held 0.929s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Created reservations ['3c35ea6c-cf67-4c75-8a83-3f9f9817f0a3', '34adc57e-ee33-4532-930d-55f15afac2f1', 'd70b4ade-0779-43d7-be7b-a7c066cab2da', '1baec040-e821-43fd-b391-023f5f4a36a7'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:12 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:12 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:12 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f 1073741824" returned: 0 in 0.487s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:12 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.281s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:12 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f Sep 25 18:05:12 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Deleted volume successfully. Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-590f5521-32b2-451c-bd33-61a3e26262cc tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-ea26129f-1820-4b8e-a9b2-5508cbe18a69-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:12 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-abf82fe7-07f5-4867-9a32-569788cc8e30 req-19cf3bd5-d0c9-45c9-b24d-800381757236 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.770s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-abf82fe7-07f5-4867-9a32-569788cc8e30 req-19cf3bd5-d0c9-45c9-b24d-800381757236 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c70290-acb6-409c-b078-581cc96844bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9536af0d-04a1-40b5-85f0-c033421d3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Volume volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f (e6f5a9f3-c033-44bd-9646-8b7a0d10d16f): created successfully Sep 25 18:05:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9536af0d-04a1-40b5-85f0-c033421d3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Flow 'volume_create_manager' (e0d3d49a-6547-4d61-a672-ac29a4af79ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-620468fc-f9c8-4d64-92c5-cc45624ddbef tempest-VolumesDeleteCascade-369989219 None] Created volume successfully. Sep 25 18:05:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-abf82fe7-07f5-4867-9a32-569788cc8e30 req-19cf3bd5-d0c9-45c9-b24d-800381757236 tempest-TestInstancesWithCinderVolumes-379235551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-cc48cc97-64fc-4b90-a577-5a1186fddac8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eda8c915-fbec-4be1-9dae-b728470678d5', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:05:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-abf82fe7-07f5-4867-9a32-569788cc8e30 req-19cf3bd5-d0c9-45c9-b24d-800381757236 tempest-TestInstancesWithCinderVolumes-379235551 None] attachment_update completed successfully. Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Flow 'volume_create_manager' (bef4343b-1c7c-4c4c-aa6b-ad83712b1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02832883-e717-42d1-8717-8c2e2d820046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02832883-e717-42d1-8717-8c2e2d820046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-718747268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7550c9b-d781-49dd-857e-e31e2e1f3108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f40bfe96344c97941d79d5084eb775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:14Z,use_quota=True,user_id='24a6530888af4d0abfb52fa78a9575ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed443cba-444e-4a91-96fa-0bda8069b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed443cba-444e-4a91-96fa-0bda8069b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01af61a9-9501-42fd-ba00-4df3e259ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01af61a9-9501-42fd-ba00-4df3e259ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7550c9b-d781-49dd-857e-e31e2e1f3108', 'volume_name': 'volume-b7550c9b-d781-49dd-857e-e31e2e1f3108', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bdc919-3001-4da1-b84b-a06f44429961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bdc919-3001-4da1-b84b-a06f44429961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9652af-bbfe-452d-aeea-ebf53cc4ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:14 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Volume b7550c9b-d781-49dd-857e-e31e2e1f3108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7550c9b-d781-49dd-857e-e31e2e1f3108', 'volume_size': 1} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-718747268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7550c9b-d781-49dd-857e-e31e2e1f3108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f40bfe96344c97941d79d5084eb775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:14Z,use_quota=True,user_id='24a6530888af4d0abfb52fa78a9575ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Creating volume b7550c9b-d781-49dd-857e-e31e2e1f3108 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:14 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:14 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 1073741824 Sep 25 18:05:14 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:14 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 1073741824" returned: 0 in 0.517s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:15 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 Sep 25 18:05:15 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:15 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108" returned: 0 in 0.318s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.860s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9652af-bbfe-452d-aeea-ebf53cc4ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7550c9b-d781-49dd-857e-e31e2e1f3108', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47bc9b8-6362-49fa-942a-b70206acb2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Creating offline snapshot 949cecfa-9d30-46e4-81c7-793562e3b9ce of volume e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:05:15 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Volume volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 (b7550c9b-d781-49dd-857e-e31e2e1f3108): created successfully Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47bc9b8-6362-49fa-942a-b70206acb2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Flow 'volume_create_manager' (bef4343b-1c7c-4c4c-aa6b-ad83712b1b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5da89b-d8d3-432a-9a34-6a76190a9569]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cadc0b3f-ee8c-4666-9c89-30338c7e0865 tempest-VolumesTransfersTest-996481135 None] Created volume successfully. Sep 25 18:05:15 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f Sep 25 18:05:15 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:15 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" returned: 0 in 0.394s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:15 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce 1G Sep 25 18:05:15 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:16 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce 1G" returned: 0 in 0.479s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:16 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce Sep 25 18:05:16 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Acquiring lock "cinder-b7550c9b-d781-49dd-857e-e31e2e1f3108-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-b7550c9b-d781-49dd-857e-e31e2e1f3108-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:16 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce" returned: 0 in 0.391s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:16 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce is being set with open permissions: ugo+rw Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:16 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce Sep 25 18:05:16 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Acquiring lock "cinder-quobyte-b7550c9b-d781-49dd-857e-e31e2e1f3108" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-quobyte-b7550c9b-d781-49dd-857e-e31e2e1f3108" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20762ed-5173-4cba-a1b3-cad26da11b81]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:16 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 Sep 25 18:05:16 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:16 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:17 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info Sep 25 18:05:17 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:17 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108" returned: 0 in 0.391s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:17 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108 Sep 25 18:05:17 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:17 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info" returned: 0 in 0.279s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:17 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info is being set with open permissions: ugo+rw Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:17 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info Sep 25 18:05:17 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:17 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b7550c9b-d781-49dd-857e-e31e2e1f3108" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-quobyte-b7550c9b-d781-49dd-857e-e31e2e1f3108" released by "delete_volume" :: held 0.709s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Created reservations ['dec6f328-6f5e-44ac-8711-8adb4b572852', '403608b7-ef7d-4928-9e22-16fd296be545', 'c4ceae7f-3fba-457f-8c28-4e04dae759de', '41041153-5ede-4035-9f5c-2976b0326bb2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:17 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.info" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:17 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:17 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8bd2e46c-6f05-4a43-a859-8a512da1bd00 tempest-VolumesDeleteCascade-369989219 None] Create snapshot completed successfully Sep 25 18:05:17 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Deleted volume successfully. Sep 25 18:05:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2bd2a610-774c-4e3b-8a28-49da316c08cd tempest-VolumesTransfersTest-1280396940 None] Lock "cinder-b7550c9b-d781-49dd-857e-e31e2e1f3108-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-f5a0c5c0-0826-405a-a1a1-255c5bf67c37 req-47dff879-96ff-4458-9fff-f869bab3a440 tempest-TestInstancesWithCinderVolumes-379235551 None] Terminate volume connection completed successfully. Sep 25 18:05:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-f5a0c5c0-0826-405a-a1a1-255c5bf67c37 req-47dff879-96ff-4458-9fff-f869bab3a440 tempest-TestInstancesWithCinderVolumes-379235551 None] Deleting attachment 000460aa-17db-4711-a967-bcac08dd2466. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "cinder-e1b15a66-7ecc-469f-8cf5-a825770be888-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-e1b15a66-7ecc-469f-8cf5-a825770be888-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Flow 'volume_create_manager' (826759c8-a222-43b1-8a8b-df8724d1cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0820ba1-d861-4361-98de-4ac09946db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0820ba1-d861-4361-98de-4ac09946db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-362266046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922e642d-4d2d-48db-af2b-4a5d4d1bc791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3f1d15552649ccb2ab80c80c7c247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=949cecfa-9d30-46e4-81c7-793562e3b9ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:19Z,use_quota=True,user_id='8a66f32baad942a39ea4edb8dfd5d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1653532b-dff7-4098-8307-1bee4173b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1653532b-dff7-4098-8307-1bee4173b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f029e71f-7e4b-47ad-af2d-7a5e06d336f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f029e71f-7e4b-47ad-af2d-7a5e06d336f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '922e642d-4d2d-48db-af2b-4a5d4d1bc791', 'volume_name': 'volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791', 'volume_size': 1, 'snapshot_id': '949cecfa-9d30-46e4-81c7-793562e3b9ce'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263df19e-2b33-46b5-b43e-8766e9c5554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263df19e-2b33-46b5-b43e-8766e9c5554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d420307-d75e-4574-b889-1f6751535d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Volume 922e642d-4d2d-48db-af2b-4a5d4d1bc791: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791', 'volume_size': 1, 'snapshot_id': '949cecfa-9d30-46e4-81c7-793562e3b9ce'} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "cinder-quobyte-e1b15a66-7ecc-469f-8cf5-a825770be888" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-949cecfa-9d30-46e4-81c7-793562e3b9ce-922e642d-4d2d-48db-af2b-4a5d4d1bc791" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-949cecfa-9d30-46e4-81c7-793562e3b9ce-922e642d-4d2d-48db-af2b-4a5d4d1bc791" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Creating volume 922e642d-4d2d-48db-af2b-4a5d4d1bc791 from snapshot 949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-922e642d-4d2d-48db-af2b-4a5d4d1bc791" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-quobyte-e1b15a66-7ecc-469f-8cf5-a825770be888" acquired by "delete_volume" :: waited 0.055s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-922e642d-4d2d-48db-af2b-4a5d4d1bc791" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] snapshot: 949cecfa-9d30-46e4-81c7-793562e3b9ce, volume: 922e642d-4d2d-48db-af2b-4a5d4d1bc791, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a38e83-5385-44ba-b202-131849b86f64]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bb74b-c85d-430c-bc58-47863c0ea8ea]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:19 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 Sep 25 18:05:19 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:19 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce Sep 25 18:05:19 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:19 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888" returned: 0 in 0.433s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:19 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888 Sep 25 18:05:19 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:19 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce" returned: 0 in 0.456s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b358f61-5d30-4cf8-813d-45063d598678]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:20 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f Sep 25 18:05:20 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:20 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e1b15a66-7ecc-469f-8cf5-a825770be888" returned: 0 in 0.386s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-quobyte-e1b15a66-7ecc-469f-8cf5-a825770be888" released by "delete_volume" :: held 0.878s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:20 devstack cinder-volume[86665]: WARNING cinder.quota [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502654381-437320836 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502654381-437320836, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:05:20 devstack cinder-volume[86665]: WARNING cinder.quota [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502654381-437320836 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502654381-437320836, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Created reservations ['c723da28-a3da-4769-adb5-663f2db9e2d9', 'f3da8a5e-cfd5-49c6-b348-9c68acb364b5', '9ff11f2a-62df-4fc5-8fd5-1459e7467637', '20ac1024-5780-4e20-8346-742abffa1705'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:20 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:20 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:20 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" returned: 0 in 0.520s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:20 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 Sep 25 18:05:20 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:20 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Deleted volume successfully. Sep 25 18:05:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7eabba98-7a98-4ac7-a17d-d291fc6858bc tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-e1b15a66-7ecc-469f-8cf5-a825770be888-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-01d10f2d-ec5f-4b87-8bf1-7bf86705bc6c req-2db80af4-432f-4dad-aa8b-a357ee7c3cb6 tempest-TestInstancesWithCinderVolumes-379235551 None] Terminate volume connection completed successfully. Sep 25 18:05:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-01d10f2d-ec5f-4b87-8bf1-7bf86705bc6c req-2db80af4-432f-4dad-aa8b-a357ee7c3cb6 tempest-TestInstancesWithCinderVolumes-379235551 None] Deleting attachment eda8c915-fbec-4be1-9dae-b728470678d5. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:05:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "cinder-cc48cc97-64fc-4b90-a577-5a1186fddac8-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-cc48cc97-64fc-4b90-a577-5a1186fddac8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "cinder-quobyte-cc48cc97-64fc-4b90-a577-5a1186fddac8" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-quobyte-cc48cc97-64fc-4b90-a577-5a1186fddac8" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5495e-574d-46b4-a547-4d611623b54f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:26 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 Sep 25 18:05:26 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:27 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8" returned: 0 in 0.826s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:27 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8 Sep 25 18:05:27 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:27 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cc48cc97-64fc-4b90-a577-5a1186fddac8" returned: 0 in 0.477s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-quobyte-cc48cc97-64fc-4b90-a577-5a1186fddac8" released by "delete_volume" :: held 1.413s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:28 devstack cinder-volume[86665]: WARNING cinder.quota [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-849103521-599383058 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-849103521-599383058, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:05:28 devstack cinder-volume[86665]: WARNING cinder.quota [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-849103521-599383058 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-849103521-599383058, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Created reservations ['112fe75a-e678-424e-ac82-40093884092e', 'af9f0812-9ce3-48a7-8a63-fd940e637ef9', '19a9fae8-27fa-4003-84c0-11d276f7b848', '46e83dd6-d845-4835-b53b-332cda177a13'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:28 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:28 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Flow 'volume_create_manager' (042a62d9-f0ff-4ea0-92c1-67f1314072ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa30a31c-bdb2-492f-a3b7-8df92b391772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa30a31c-bdb2-492f-a3b7-8df92b391772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-829852859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec58692a9bc4c839690829c5cabf284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:29Z,use_quota=True,user_id='aa531ccf11204686857e30ec19dd2adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43f2f0c-baee-4bbf-9326-df94210d4a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43f2f0c-baee-4bbf-9326-df94210d4a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cfc316-0203-48ce-a628-13d879ff8cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cfc316-0203-48ce-a628-13d879ff8cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'volume_name': 'volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ed69c9-2607-49d7-9517-e37d21f78b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ed69c9-2607-49d7-9517-e37d21f78b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c19a597-12a0-47ff-915c-ae731e863c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Volume a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'volume_size': 1} Sep 25 18:05:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:29 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.673s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:29 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Deleted volume successfully. Sep 25 18:05:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad6e30ee-2020-4199-9f44-90595bc3c6e9 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-cc48cc97-64fc-4b90-a577-5a1186fddac8-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:30 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-89fd8b1a-1369-4a57-b965-37134c5da083 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791" returned: 0 in 9.901s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:05:30 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Converted 1024.00 MB image at 103.41 MB/s Sep 25 18:05:30 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 is being set with open permissions: ugo+rw Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:30 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 Sep 25 18:05:30 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:30 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-922e642d-4d2d-48db-af2b-4a5d4d1bc791" released by "_copy_volume_from_snapshot" :: held 11.347s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-949cecfa-9d30-46e4-81c7-793562e3b9ce-922e642d-4d2d-48db-af2b-4a5d4d1bc791" released by "_create_volume_from_snapshot" :: held 11.440s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.459s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.042s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-829852859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec58692a9bc4c839690829c5cabf284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:29Z,use_quota=True,user_id='aa531ccf11204686857e30ec19dd2adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Creating volume a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:30 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:30 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 1073741824 Sep 25 18:05:30 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d420307-d75e-4574-b889-1f6751535d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791', 'volume_size': 1, 'snapshot_id': '949cecfa-9d30-46e4-81c7-793562e3b9ce'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21b4c61-8a9a-4554-8f65-a7aa24868396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Volume volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 (922e642d-4d2d-48db-af2b-4a5d4d1bc791): created successfully Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21b4c61-8a9a-4554-8f65-a7aa24868396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Flow 'volume_create_manager' (826759c8-a222-43b1-8a8b-df8724d1cada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c100743c-8d17-4e34-9cdb-ed1c158ce857 tempest-VolumesDeleteCascade-369989219 None] Created volume successfully. Sep 25 18:05:31 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 1073741824" returned: 0 in 0.541s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:31 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 Sep 25 18:05:31 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:31 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" returned: 0 in 0.366s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-89fd8b1a-1369-4a57-b965-37134c5da083 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.375s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-89fd8b1a-1369-4a57-b965-37134c5da083 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c19a597-12a0-47ff-915c-ae731e863c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad160624-2352-4c7a-bb3b-fa482096177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:31 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Volume volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 (a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3): created successfully Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad160624-2352-4c7a-bb3b-fa482096177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Flow 'volume_create_manager' (042a62d9-f0ff-4ea0-92c1-67f1314072ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2c3642a1-4b16-4831-b0bd-b4195db41860 tempest-VolumesCloneTest-406769875 None] Created volume successfully. Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-89fd8b1a-1369-4a57-b965-37134c5da083 tempest-TestServerVolumeAttachmentScenario-368996325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-8287f121-5478-4069-928b-0c5780694164', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d1f2201-a717-4b02-ba2f-99323c2c69a9', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:05:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-89fd8b1a-1369-4a57-b965-37134c5da083 tempest-TestServerVolumeAttachmentScenario-368996325 None] attachment_update completed successfully. Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Performing cascade delete. {{(pid=86665) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-949cecfa-9d30-46e4-81c7-793562e3b9ce-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-949cecfa-9d30-46e4-81c7-793562e3b9ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-949cecfa-9d30-46e4-81c7-793562e3b9ce" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-949cecfa-9d30-46e4-81c7-793562e3b9ce" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Deleting offline snapshot 949cecfa-9d30-46e4-81c7-793562e3b9ce of volume e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] snapshot_file for this snap is: volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[62303201-d6e2-4856-bc30-c5cc9a321a71]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:32 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce Sep 25 18:05:32 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-6708cd01-c5e1-409d-beb6-3e4c7c5de9ea tempest-TestServerVolumeAttachmentScenario-368996325 None] Terminate volume connection completed successfully. Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-4eb702b4-fa23-435a-b57d-baf4e46ad70f req-6708cd01-c5e1-409d-beb6-3e4c7c5de9ea tempest-TestServerVolumeAttachmentScenario-368996325 None] Deleting attachment 7d1f2201-a717-4b02-ba2f-99323c2c69a9. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:05:32 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce" returned: 0 in 0.649s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7a8fc3-b09e-46bc-9b4a-4db536796196]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:33 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f Sep 25 18:05:33 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Flow 'volume_create_manager' (6262c7eb-8974-44e6-b2da-d4c48c823450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38eebc74-73b0-4370-a74d-973b3ba24e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38eebc74-73b0-4370-a74d-973b3ba24e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1471851890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d02ffe-8c92-4da8-8aa4-6061b71b4a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec58692a9bc4c839690829c5cabf284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:33Z,use_quota=True,user_id='aa531ccf11204686857e30ec19dd2adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3170f6-ea3a-4b1b-8c63-9176bf9c267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3170f6-ea3a-4b1b-8c63-9176bf9c267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df559d7e-3f1c-408f-96fe-8f2c13c9d3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df559d7e-3f1c-408f-96fe-8f2c13c9d3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '78d02ffe-8c92-4da8-8aa4-6061b71b4a23', 'volume_name': 'volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23', 'volume_size': 2, 'source_volid': 'a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'source_volstatus': 'available'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eed31a-8185-4cc0-b69d-4da05f8714a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eed31a-8185-4cc0-b69d-4da05f8714a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236199f7-c5e8-44d7-afd4-892d78f7aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Volume 78d02ffe-8c92-4da8-8aa4-6061b71b4a23: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23', 'volume_size': 2, 'source_volid': 'a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'source_volstatus': 'available'} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:33 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Cloning volume a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 to volume 78d02ffe-8c92-4da8-8aa4-6061b71b4a23 Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Creating offline snapshot 114f08fc-435e-464a-a078-876efb81b12a of volume a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:05:33 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" returned: 0 in 0.762s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e256f-704d-40ea-9ebd-17c2c117d3b8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:33 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce Sep 25 18:05:33 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:33 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 Sep 25 18:05:33 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:34 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce" returned: 0 in 0.342s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:34 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce Sep 25 18:05:34 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:34 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:34 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a 1G Sep 25 18:05:34 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:34 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f.949cecfa-9d30-46e4-81c7-793562e3b9ce" returned: 0 in 0.335s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-949cecfa-9d30-46e4-81c7-793562e3b9ce" released by "_delete_snapshot" :: held 2.229s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" released by "delete_snapshot" :: held 2.257s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Created reservations ['16ac2485-f79c-42d7-b6b1-9e53d43ca2fd', 'edb3f14e-14d3-41e1-ad74-03052d22fd3c', 'a7b9d562-1cb5-42b1-b0a4-14b2822b8d61', '43a97f14-ec6d-418f-b406-3f246f46d61a'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Delete snapshot completed successfully. Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-949cecfa-9d30-46e4-81c7-793562e3b9ce-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Snapshots deleted, issuing volume delete {{(pid=86665) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:34 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aebc9e5-4cd1-4dce-adf5-0ace7c68d9dc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a 1G" returned: 0 in 0.594s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:34 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a Sep 25 18:05:34 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-4281633a-6f26-4a60-9efe-aa0cb7434c4a req-0955d48a-8b81-42a7-a192-2217df1e33df tempest-TestInstancesWithCinderVolumes-379235551 None] Terminate volume connection completed successfully. Sep 25 18:05:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-4281633a-6f26-4a60-9efe-aa0cb7434c4a req-0955d48a-8b81-42a7-a192-2217df1e33df tempest-TestInstancesWithCinderVolumes-379235551 None] Deleting attachment 74076e33-11ee-40a9-974e-9a1b0fb39bb3. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:05:34 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f Sep 25 18:05:34 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:35 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a" returned: 0 in 0.328s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a is being set with open permissions: ugo+rw Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:35 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a Sep 25 18:05:35 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:35 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" returned: 0 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:35 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f Sep 25 18:05:35 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:35 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a" returned: 0 in 0.305s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:35 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" returned: 0 in 0.296s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info Sep 25 18:05:35 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f" released by "delete_volume" :: held 0.809s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Created reservations ['5b2da47d-7e34-480f-9915-79fa96f8c644', '3578652e-3c82-4762-ac37-fb719ee733b7', 'cd939cc8-fb0b-421e-a45b-65916a9bec20', '10af720c-4248-49ca-8f29-e7a5c2b2cfcb'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:35 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:35 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:35 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info" returned: 0 in 0.291s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info is being set with open permissions: ugo+rw Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:35 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info Sep 25 18:05:35 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:35 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Deleted volume successfully. Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "cinder-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-016ed5f5-4071-40b4-b985-22b6399b8fc9 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-e6f5a9f3-c033-44bd-9646-8b7a0d10d16f-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "cinder-quobyte-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-quobyte-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e8a0e6-c707-462a-a57c-0e8633afbbe6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:35 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.info" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Acquiring lock "cinder-quobyte-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] snapshot: 114f08fc-435e-464a-a078-876efb81b12a, volume: 78d02ffe-8c92-4da8-8aa4-6061b71b4a23, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[940397bf-b6d9-44bd-b4ad-fbc70837fc9c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:36 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 Sep 25 18:05:36 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:36 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a Sep 25 18:05:36 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:36 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" returned: 0 in 0.384s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:36 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11 Sep 25 18:05:36 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:36 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a" returned: 0 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6ee1d-d1e0-40d4-83c4-6681e262b11e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:36 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 Sep 25 18:05:36 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:36 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" returned: 0 in 0.303s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-quobyte-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11" released by "delete_volume" :: held 0.731s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:36 devstack cinder-volume[86665]: WARNING cinder.quota [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976278576-1608602138 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976278576-1608602138, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:05:36 devstack cinder-volume[86665]: WARNING cinder.quota [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976278576-1608602138 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976278576-1608602138, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-922e642d-4d2d-48db-af2b-4a5d4d1bc791-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-922e642d-4d2d-48db-af2b-4a5d4d1bc791-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Created reservations ['b4c56cd9-8258-4de6-91ed-c410e48b31e0', '92c2490c-55d3-43a7-8647-9dee00c0a8cf', '74bf00c8-dab9-46b0-b88d-7ddab8b3fd7a', 'dd4a5e3e-f4f8-4aa3-bb11-8bf7966b592e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "cinder-quobyte-922e642d-4d2d-48db-af2b-4a5d4d1bc791" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-922e642d-4d2d-48db-af2b-4a5d4d1bc791" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca769589-2a29-4ed2-a60b-336d2ff818d2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:36 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:05:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:36 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:36 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:36 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 Sep 25 18:05:36 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:36 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 Sep 25 18:05:36 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:37 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.282s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Deleted volume successfully. Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-59890d53-0bfe-4036-9baf-5443971fd335 tempest-TestInstancesWithCinderVolumes-379235551 None] Lock "cinder-9aa53bb4-94f4-4a21-84d8-9c7b4d034f11-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:37 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791" returned: 0 in 0.457s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:37 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791 Sep 25 18:05:37 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:37 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-922e642d-4d2d-48db-af2b-4a5d4d1bc791" returned: 0 in 0.361s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-quobyte-922e642d-4d2d-48db-af2b-4a5d4d1bc791" released by "delete_volume" :: held 0.887s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:37 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Created reservations ['b9698e5f-077e-4daf-bc15-06851f156735', '9e0f832a-74fe-48f8-a32c-af07ac60ad9e', '2cd431a5-7b8c-4f65-a797-d0122e47c17e', '22084d3e-b3be-4ecb-8b89-07de299d3176'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:38 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:38 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:38 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.613s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Deleted volume successfully. Sep 25 18:05:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-065a547c-a121-42c5-9c08-7ca60e3f4242 tempest-VolumesDeleteCascade-369989219 None] Lock "cinder-922e642d-4d2d-48db-af2b-4a5d4d1bc791-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:45 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" returned: 0 in 8.827s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:45 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3, size 1024.00 MB, duration 8.83 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:05:45 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Converted 1024.00 MB image at 115.99 MB/s Sep 25 18:05:45 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 is being set with open permissions: ugo+rw Sep 25 18:05:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:45 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 Sep 25 18:05:45 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:45 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" released by "_copy_volume_from_snapshot" :: held 10.001s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=115,cinder:UPDATE=130,cinder:INSERT=35,cinder:DELETE=12 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Acquiring lock "cinder-quobyte-114f08fc-435e-464a-a078-876efb81b12a" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-114f08fc-435e-464a-a078-876efb81b12a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Deleting offline snapshot 114f08fc-435e-464a-a078-876efb81b12a of volume a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] snapshot_file for this snap is: volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c096536-c29e-4d4d-9fc9-8f127ebb23e8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:46 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a Sep 25 18:05:46 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:46 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a" returned: 0 in 0.386s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c76fcf-8b8e-4c87-b2c4-58ae4b6393af]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:46 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 Sep 25 18:05:46 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:47 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" returned: 0 in 0.719s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:47 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a Sep 25 18:05:47 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:47 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a" returned: 0 in 0.479s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:47 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a Sep 25 18:05:47 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:47 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3.114f08fc-435e-464a-a078-876efb81b12a" returned: 0 in 0.282s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-114f08fc-435e-464a-a078-876efb81b12a" released by "_delete_snapshot" :: held 1.980s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=125,cinder:SELECT=136,cinder:INSERT=39,cinder:DELETE=9 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.415s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236199f7-c5e8-44d7-afd4-892d78f7aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23', 'volume_size': 2, 'source_volid': 'a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3', 'source_volstatus': 'available'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e27532-7b67-4c1d-862a-7f5c9a0dafb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:48 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Volume volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 (78d02ffe-8c92-4da8-8aa4-6061b71b4a23): created successfully Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e27532-7b67-4c1d-862a-7f5c9a0dafb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Flow 'volume_create_manager' (6262c7eb-8974-44e6-b2da-d4c48c823450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cd2ebee8-2e2a-41a8-9978-4de13b79712c tempest-VolumesCloneTest-406769875 None] Created volume successfully. Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Flow 'volume_create_manager' (f8b650f8-ecfd-41ba-bf30-536b1addc393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db4402a-9ce4-4fb8-8d1c-5edc2630699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db4402a-9ce4-4fb8-8d1c-5edc2630699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1732124112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7148632d-7b56-4edd-820c-8fc706be56bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f87600efe4d56974cfad97d3da211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:49Z,use_quota=True,user_id='a4014588bc644c9cafab7fe7255ec6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f90ac2-41f1-43c4-9974-f61ebc2a15db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f90ac2-41f1-43c4-9974-f61ebc2a15db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caddd03-dfea-4234-a7d2-43f23c73cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caddd03-dfea-4234-a7d2-43f23c73cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7148632d-7b56-4edd-820c-8fc706be56bd', 'volume_name': 'volume-7148632d-7b56-4edd-820c-8fc706be56bd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4c8e7d-b9f5-40a8-b797-5048e1a71c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4c8e7d-b9f5-40a8-b797-5048e1a71c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2caea1-7154-40cf-ba62-79376a3fc0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:48 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Volume 7148632d-7b56-4edd-820c-8fc706be56bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7148632d-7b56-4edd-820c-8fc706be56bd', 'volume_size': 1} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1732124112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7148632d-7b56-4edd-820c-8fc706be56bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f87600efe4d56974cfad97d3da211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:49Z,use_quota=True,user_id='a4014588bc644c9cafab7fe7255ec6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Creating volume 7148632d-7b56-4edd-820c-8fc706be56bd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:48 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:48 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd 1073741824 Sep 25 18:05:48 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:49 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd 1073741824" returned: 0 in 0.524s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:49 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd Sep 25 18:05:49 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Acquiring lock "cinder-78d02ffe-8c92-4da8-8aa4-6061b71b4a23-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Lock "cinder-78d02ffe-8c92-4da8-8aa4-6061b71b4a23-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Acquiring lock "cinder-quobyte-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:49 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2caea1-7154-40cf-ba62-79376a3fc0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7148632d-7b56-4edd-820c-8fc706be56bd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee8766e-158a-4f63-8ef4-5021c249ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff96733-190f-4db8-a2ff-187e3a5b49e3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:49 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Volume volume-7148632d-7b56-4edd-820c-8fc706be56bd (7148632d-7b56-4edd-820c-8fc706be56bd): created successfully Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee8766e-158a-4f63-8ef4-5021c249ab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Flow 'volume_create_manager' (f8b650f8-ecfd-41ba-bf30-536b1addc393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b5ef3581-ce0a-4272-a181-869a9b674f5a tempest-VolumesTransfersV357Test-1285956854 None] Created volume successfully. Sep 25 18:05:49 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 Sep 25 18:05:49 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:49 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" returned: 0 in 0.376s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:49 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23 Sep 25 18:05:49 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:50 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-78d02ffe-8c92-4da8-8aa4-6061b71b4a23" released by "delete_volume" :: held 0.696s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Created reservations ['342ba414-8880-4932-9595-725c114c16e8', '5399adae-e66a-48f4-a0ce-43facf34a3f1', '915aeba4-13b3-4459-a089-93ec5ccac73d', '0c0f8881-5145-4a93-8148-2c8e05e37543'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:50 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:50 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:50 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.272s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Deleted volume successfully. Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Acquiring lock "cinder-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d99f0540-e5e9-49f3-867c-266075cc8e62 tempest-VolumesCloneTest-406769875 None] Lock "cinder-78d02ffe-8c92-4da8-8aa4-6061b71b4a23-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Lock "cinder-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Acquiring lock "cinder-quobyte-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[40422411-189d-4e18-922f-6133909763c7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:50 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 Sep 25 18:05:50 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:51 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" returned: 0 in 0.582s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:51 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3 Sep 25 18:05:51 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-94f3279e-1ef0-487b-9de2-6d8ec0439261 tempest-VolumesTransfersV357Test-1692892973 None] Transfer volume completed successfully. Sep 25 18:05:51 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" returned: 0 in 0.320s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Lock "cinder-quobyte-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3" released by "delete_volume" :: held 0.984s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Created reservations ['1c546bfa-280c-4b64-b30e-ea3e4ec021a5', '9b4baac9-bbac-44dc-a856-68f3c24248bf', '98253a29-e396-41c7-8845-9548ff384ebd', 'd07adb58-3c47-491b-b420-dc52332601ad'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:51 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:51 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:52 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Acquiring lock "cinder-7148632d-7b56-4edd-820c-8fc706be56bd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Deleted volume successfully. Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-7148632d-7b56-4edd-820c-8fc706be56bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-777695e0-784d-49c4-9dd3-558e1e25d599 tempest-VolumesCloneTest-406769875 None] Lock "cinder-a5aa39f2-1c2d-40d0-8f79-48ebdf78e4a3-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Acquiring lock "cinder-quobyte-7148632d-7b56-4edd-820c-8fc706be56bd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-quobyte-7148632d-7b56-4edd-820c-8fc706be56bd" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8673af1-31b7-4877-9aed-951b24e81bd1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:52 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd Sep 25 18:05:52 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:52 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd" returned: 0 in 0.403s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:52 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd Sep 25 18:05:52 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:53 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7148632d-7b56-4edd-820c-8fc706be56bd" returned: 0 in 0.288s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-quobyte-7148632d-7b56-4edd-820c-8fc706be56bd" released by "delete_volume" :: held 0.737s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Created reservations ['786d0076-9c19-43e8-b2f3-a4904a38abfd', '9528d0c0-4d2e-4364-b073-8153749fc394', '4665281d-43da-4886-ad4f-7beb64a0a3dc', '566c9118-9409-4c6c-8a40-213ab68c3c5b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:53 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:53 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:53 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Deleted volume successfully. Sep 25 18:05:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-746a4b40-4977-4d31-bd95-904a8f9af501 tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-7148632d-7b56-4edd-820c-8fc706be56bd-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Flow 'volume_create_manager' (d0a345eb-b53a-443a-ad10-50341a1c0fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d7504c-edbe-49ce-b078-e6be18f3b46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d7504c-edbe-49ce-b078-e6be18f3b46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-190683602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec33a6-b465-46cf-aaac-2684ea0824f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f87600efe4d56974cfad97d3da211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:54Z,use_quota=True,user_id='a4014588bc644c9cafab7fe7255ec6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078046dd-8f89-46fb-baa2-c67845be0957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078046dd-8f89-46fb-baa2-c67845be0957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597f7a90-9beb-4f0a-9d0d-1c9251644506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597f7a90-9beb-4f0a-9d0d-1c9251644506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bec33a6-b465-46cf-aaac-2684ea0824f5', 'volume_name': 'volume-9bec33a6-b465-46cf-aaac-2684ea0824f5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e210dd-5e3e-471c-aca7-a55d655bc9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e210dd-5e3e-471c-aca7-a55d655bc9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed5d8b6-5bce-4319-9d4b-3225f2a65e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:54 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Volume 9bec33a6-b465-46cf-aaac-2684ea0824f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bec33a6-b465-46cf-aaac-2684ea0824f5', 'volume_size': 1} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-190683602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec33a6-b465-46cf-aaac-2684ea0824f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f87600efe4d56974cfad97d3da211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:54Z,use_quota=True,user_id='a4014588bc644c9cafab7fe7255ec6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Creating volume 9bec33a6-b465-46cf-aaac-2684ea0824f5 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:54 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:54 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 1073741824 Sep 25 18:05:54 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:54 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 1073741824" returned: 0 in 0.544s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:54 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 Sep 25 18:05:54 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:55 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed5d8b6-5bce-4319-9d4b-3225f2a65e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bec33a6-b465-46cf-aaac-2684ea0824f5', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c141f3-d33b-4d75-a0f0-8eded7dc794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:55 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Volume volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 (9bec33a6-b465-46cf-aaac-2684ea0824f5): created successfully Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c141f3-d33b-4d75-a0f0-8eded7dc794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Flow 'volume_create_manager' (d0a345eb-b53a-443a-ad10-50341a1c0fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d2c13be9-bcad-4171-b239-374a9c6c29d4 tempest-VolumesTransfersV357Test-1285956854 None] Created volume successfully. Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:55 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:55 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:56 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Acquiring lock "cinder-9bec33a6-b465-46cf-aaac-2684ea0824f5-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-9bec33a6-b465-46cf-aaac-2684ea0824f5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Acquiring lock "cinder-quobyte-9bec33a6-b465-46cf-aaac-2684ea0824f5" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-quobyte-9bec33a6-b465-46cf-aaac-2684ea0824f5" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa83d5e-3f68-41c8-bde9-631a568ff304]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:56 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 Sep 25 18:05:56 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:57 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5" returned: 0 in 0.475s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:57 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5 Sep 25 18:05:57 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Flow 'volume_create_manager' (37c75e52-7974-47bb-88ef-85d1d73a2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b18fa0-b724-4897-8e66-2a5b4ac1bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b18fa0-b724-4897-8e66-2a5b4ac1bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-646781582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb8c65e-2b4a-48ff-ba37-93f2d83544a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='354e751941fe466a906ce7a66cb15cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:57Z,use_quota=True,user_id='32570c4a677a49a892f4931998352bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820a3850-6250-4964-848d-a7924e8e3432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820a3850-6250-4964-848d-a7924e8e3432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5758f68-6e37-4f4d-bd70-81ec552a18db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5758f68-6e37-4f4d-bd70-81ec552a18db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb8c65e-2b4a-48ff-ba37-93f2d83544a9', 'volume_name': 'volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9', 'volume_size': 2}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6346680b-332f-4edb-9562-198f7f07112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6346680b-332f-4edb-9562-198f7f07112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d98a48-ffdc-4783-9d0f-08c66c41b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:57 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Volume 3eb8c65e-2b4a-48ff-ba37-93f2d83544a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9', 'volume_size': 2} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-646781582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb8c65e-2b4a-48ff-ba37-93f2d83544a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='354e751941fe466a906ce7a66cb15cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:05:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:05:57Z,use_quota=True,user_id='32570c4a677a49a892f4931998352bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Creating volume 3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:05:57 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 2147483648 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:57 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 2147483648 Sep 25 18:05:57 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:57 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9bec33a6-b465-46cf-aaac-2684ea0824f5" returned: 0 in 0.271s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-quobyte-9bec33a6-b465-46cf-aaac-2684ea0824f5" released by "delete_volume" :: held 0.848s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Created reservations ['7da75ce0-f7bf-4572-b287-9c4a4edead12', '6168aa98-53e3-4609-9546-882ac62a3fae', '89c1b777-3fea-4aa0-957b-82b6cf317fdc', '89cceac8-c076-4042-ac3f-cb731dcf7c4f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:57 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:05:57 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:57 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.364s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:05:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Deleted volume successfully. Sep 25 18:05:58 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 2147483648" returned: 0 in 0.669s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-84dc6219-5cdd-4a89-b71f-d566c162eace tempest-VolumesTransfersV357Test-990557913 None] Lock "cinder-9bec33a6-b465-46cf-aaac-2684ea0824f5-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:58 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 Sep 25 18:05:58 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:05:58 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d98a48-ffdc-4783-9d0f-08c66c41b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9', 'volume_size': 2}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22b6a3b-03e3-41c4-879b-6d7400f80c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:05:58 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Volume volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 (3eb8c65e-2b4a-48ff-ba37-93f2d83544a9): created successfully Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22b6a3b-03e3-41c4-879b-6d7400f80c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:05:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Flow 'volume_create_manager' (37c75e52-7974-47bb-88ef-85d1d73a2039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:05:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6ee8a11c-675d-4659-aa94-7ddddbcc2063 tempest-VolumesCloneNegativeTest-457470083 None] Created volume successfully. Sep 25 18:05:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Acquiring lock "cinder-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Lock "cinder-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Acquiring lock "cinder-quobyte-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:05:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Lock "cinder-quobyte-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:05:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b4559a-9467-4e6c-ab2d-e350d6b3df3f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:05:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:05:59 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 Sep 25 18:05:59 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:00 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9" returned: 0 in 0.469s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:00 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9 Sep 25 18:06:00 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:00 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9" returned: 0 in 0.278s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Lock "cinder-quobyte-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9" released by "delete_volume" :: held 0.803s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Created reservations ['ae809c45-9052-4f84-b391-79851ce0fd01', 'd1f3d983-27f8-4265-93c2-b623fb2c129e', '57fa302f-e638-4dce-8e46-d2349c6b258a', 'aa86a959-874b-4ddf-9459-974b78b96165'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:00 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:06:00 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:01 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:01 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:06:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Deleted volume successfully. Sep 25 18:06:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ca2643bc-a76c-4df4-88c2-995dedb8d5cf tempest-VolumesCloneNegativeTest-457470083 None] Lock "cinder-3eb8c65e-2b4a-48ff-ba37-93f2d83544a9-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Flow 'volume_create_manager' (6edaba15-65f4-4a85-b9af-4c402c6be5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28600363-f2a1-4de7-841d-f4b4a2a1e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28600363-f2a1-4de7-841d-f4b4a2a1e787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-152015839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b505d71f-e5d7-46c2-bbf4-17cfa545c364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe83427076340568be3bfa02177167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:08Z,use_quota=True,user_id='5d19d9b465b44602b1a91c3ca445f129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4312c0b1-9ab4-40aa-b7a2-21029fd0d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4312c0b1-9ab4-40aa-b7a2-21029fd0d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee0a5bb-5d9a-4b38-ad1d-0e07da3293d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee0a5bb-5d9a-4b38-ad1d-0e07da3293d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b505d71f-e5d7-46c2-bbf4-17cfa545c364', 'volume_name': 'volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278c5d0a-dee9-4131-bcf0-9d8b07f43a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278c5d0a-dee9-4131-bcf0-9d8b07f43a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cd6b46-8179-44f3-8264-b275518233e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Volume b505d71f-e5d7-46c2-bbf4-17cfa545c364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364', 'volume_size': 1} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-152015839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b505d71f-e5d7-46c2-bbf4-17cfa545c364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe83427076340568be3bfa02177167c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:08Z,use_quota=True,user_id='5d19d9b465b44602b1a91c3ca445f129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Creating volume b505d71f-e5d7-46c2-bbf4-17cfa545c364 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:06:08 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:08 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 1073741824 Sep 25 18:06:08 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:08 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 1073741824" returned: 0 in 0.526s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:09 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 Sep 25 18:06:09 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:09 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364" returned: 0 in 0.344s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cd6b46-8179-44f3-8264-b275518233e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70f8354-fc05-4389-9134-c7f6d40f89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:09 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Volume volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 (b505d71f-e5d7-46c2-bbf4-17cfa545c364): created successfully Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70f8354-fc05-4389-9134-c7f6d40f89ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Flow 'volume_create_manager' (6edaba15-65f4-4a85-b9af-4c402c6be5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-de200439-e932-4d72-83f2-d4831e6ac8e1 tempest-VolumesNegativeTest-1117433083 None] Created volume successfully. Sep 25 18:06:19 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=51,cinder:SELECT=46,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:06:19 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=58,cinder:SELECT=23,cinder:INSERT=11,cinder:DELETE=8 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (76cac232-5989-4fff-b454-8561870ec5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c89d3d-a99a-466c-9fd6-8aaefc3046a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c89d3d-a99a-466c-9fd6-8aaefc3046a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1550482410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9595b7db-d385-4611-bf7d-c3622959a6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:25Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6265fb89-78c6-4f3a-84dc-d09738bf5805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6265fb89-78c6-4f3a-84dc-d09738bf5805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4104d09-eaa1-43e9-8f0a-a102d268e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4104d09-eaa1-43e9-8f0a-a102d268e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9595b7db-d385-4611-bf7d-c3622959a6a4', 'volume_name': 'volume-9595b7db-d385-4611-bf7d-c3622959a6a4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfe199e-aba3-4643-a93f-056855a1c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfe199e-aba3-4643-a93f-056855a1c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402706c8-c928-49dc-8276-7492eeaff9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Volume 9595b7db-d385-4611-bf7d-c3622959a6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9595b7db-d385-4611-bf7d-c3622959a6a4', 'volume_size': 1} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1550482410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9595b7db-d385-4611-bf7d-c3622959a6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:25Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Creating volume 9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:06:25 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:25 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 1073741824 Sep 25 18:06:25 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:25 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 1073741824" returned: 0 in 0.620s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:25 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 Sep 25 18:06:25 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:26 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402706c8-c928-49dc-8276-7492eeaff9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9595b7db-d385-4611-bf7d-c3622959a6a4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5f11a4-af23-47a6-a704-e24d9be9c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Volume volume-9595b7db-d385-4611-bf7d-c3622959a6a4 (9595b7db-d385-4611-bf7d-c3622959a6a4): created successfully Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5f11a4-af23-47a6-a704-e24d9be9c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (76cac232-5989-4fff-b454-8561870ec5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:26 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-832b8b4c-ea60-482f-b455-590d5d8fc958 tempest-VolumesSnapshotTestJSON-139093961 None] Created volume successfully. Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Flow 'volume_create_manager' (b2633a61-de93-4b4c-be1c-be1c3f52fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309c885b-5f32-4185-9a23-e925c0ebb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309c885b-5f32-4185-9a23-e925c0ebb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2100365450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31338c2-bcd2-45b3-b8c1-f1d10977e8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae0c1e3e7884c0e8b5dd86970454a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:27Z,use_quota=True,user_id='15acc13abfda4125b2dcfbfb4453826b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174d1efd-d0f6-4c2d-81e8-152cec01d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174d1efd-d0f6-4c2d-81e8-152cec01d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6a3d90-35ff-4cff-822b-c1041a1ec545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:26 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6a3d90-35ff-4cff-822b-c1041a1ec545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f31338c2-bcd2-45b3-b8c1-f1d10977e8ef', 'volume_name': 'volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a58403-17e0-42ea-9b40-3cb95f6b63fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a58403-17e0-42ea-9b40-3cb95f6b63fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f978b8f4-3164-437d-862f-e456631b9ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:27 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Volume f31338c2-bcd2-45b3-b8c1-f1d10977e8ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Trying to clone f31338c2-bcd2-45b3-b8c1-f1d10977e8ef from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Creating offline snapshot f1b924d3-fa6f-4482-b5ad-82cca6da7333 of volume 9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d45fbb-0576-46bb-ba83-863454da2eb9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:06:27 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Image download 20.69 MB at 20.69 MB/s Sep 25 18:06:27 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 Sep 25 18:06:27 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f657171-c576-43ff-8690-09da7cb94a5a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:28 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD Sep 25 18:06:28 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:28 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4" returned: 0 in 0.551s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:28 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 1G Sep 25 18:06:28 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:28 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD" returned: 0 in 0.508s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 is fetched for user 15acc13abfda4125b2dcfbfb4453826b. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc159c-6039-4bb5-9abd-46787181d1a4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:28 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD Sep 25 18:06:28 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:28 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 1G" returned: 0 in 0.581s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9595b7db-d385-4611-bf7d-c3622959a6a4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:28 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9595b7db-d385-4611-bf7d-c3622959a6a4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 Sep 25 18:06:28 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:28 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:29 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9595b7db-d385-4611-bf7d-c3622959a6a4 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333" returned: 0 in 0.366s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:29 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 is being set with open permissions: ugo+rw Sep 25 18:06:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:29 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 Sep 25 18:06:29 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:29 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:29 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info Sep 25 18:06:29 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:29 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:29 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info is being set with open permissions: ugo+rw Sep 25 18:06:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:29 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info Sep 25 18:06:29 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:30 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.info" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2100365450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31338c2-bcd2-45b3-b8c1-f1d10977e8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae0c1e3e7884c0e8b5dd86970454a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:27Z,use_quota=True,user_id='15acc13abfda4125b2dcfbfb4453826b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Creating volume f31338c2-bcd2-45b3-b8c1-f1d10977e8ef {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:06:30 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:30 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef 1073741824 Sep 25 18:06:30 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7f900869-b3aa-4d7d-b318-4eb32715424e tempest-VolumesSnapshotTestJSON-139093961 None] Create snapshot completed successfully Sep 25 18:06:30 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef 1073741824" returned: 0 in 0.475s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:30 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef Sep 25 18:06:30 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:30 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-f1b924d3-fa6f-4482-b5ad-82cca6da7333-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:30 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Attempting download of cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume f31338c2-bcd2-45b3-b8c1-f1d10977e8ef. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-f1b924d3-fa6f-4482-b5ad-82cca6da7333-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b364ef8-abc5-41f1-b2f2-561dede81fd6]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-9595b7db-d385-4611-bf7d-c3622959a6a4" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-9595b7db-d385-4611-bf7d-c3622959a6a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-f1b924d3-fa6f-4482-b5ad-82cca6da7333" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-f1b924d3-fa6f-4482-b5ad-82cca6da7333" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Deleting offline snapshot f1b924d3-fa6f-4482-b5ad-82cca6da7333 of volume 9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] snapshot_file for this snap is: volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a3887-4fec-4a2e-abce-7bef209e020c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:31 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt Sep 25 18:06:31 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:31 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 Sep 25 18:06:31 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:31 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt" returned: 0 in 0.366s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:31 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt Sep 25 18:06:31 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:31 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333" returned: 0 in 0.392s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9595b7db-d385-4611-bf7d-c3622959a6a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6144cdcd-64a2-4b77-bcdc-11614ac17f63]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:31 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 Sep 25 18:06:31 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:31 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt" returned: 1 in 0.366s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_1zzr8drt' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2475b03a-95b4-4543-b6fd-0a582a06d739]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:31 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD Sep 25 18:06:31 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:32 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4" returned: 0 in 0.426s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:32 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 Sep 25 18:06:32 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:32 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 was qcow2, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:32 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef Sep 25 18:06:32 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:32 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:32 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333 Sep 25 18:06:32 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:32 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4.f1b924d3-fa6f-4482-b5ad-82cca6da7333" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-f1b924d3-fa6f-4482-b5ad-82cca6da7333" released by "_delete_snapshot" :: held 1.686s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-9595b7db-d385-4611-bf7d-c3622959a6a4" released by "delete_snapshot" :: held 1.716s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['1d8ee91b-ea10-47fb-87d0-8e693e68cb6d', '1179a882-ca1d-4321-a16f-6336d490421b', '7d67ba28-7bbd-48ee-b74f-f150300e4a06', 'ef435e31-552e-4947-901f-abfeed8fdac6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:06:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Delete snapshot completed successfully. Sep 25 18:06:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2cc6faf9-f926-4112-bd0f-8a5b15637e26 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-f1b924d3-fa6f-4482-b5ad-82cca6da7333-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:33 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:06:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (a3803dad-730b-40d4-8767-d1d3c3177435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616ba94a-a3c0-4ebb-8ef8-869be6cfbaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616ba94a-a3c0-4ebb-8ef8-869be6cfbaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-546911954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13dfb26-7eed-464a-994d-2108d0822a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:34Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc4be0e-ff70-4b6f-81f7-6d1f8f47805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc4be0e-ff70-4b6f-81f7-6d1f8f47805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8515e9b7-5141-456d-a4fd-075856bf97ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8515e9b7-5141-456d-a4fd-075856bf97ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13dfb26-7eed-464a-994d-2108d0822a9d', 'volume_name': 'volume-f13dfb26-7eed-464a-994d-2108d0822a9d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e71cd2-e4c5-4e48-8616-11188ee6ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e71cd2-e4c5-4e48-8616-11188ee6ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7abe072-68d9-42e5-a3b3-c82eb349e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Volume f13dfb26-7eed-464a-994d-2108d0822a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13dfb26-7eed-464a-994d-2108d0822a9d', 'volume_size': 1} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-546911954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13dfb26-7eed-464a-994d-2108d0822a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:34Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Creating volume f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:06:34 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:34 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d 1073741824 Sep 25 18:06:34 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:34 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" returned: 0 in 2.340s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0f4e7e-b12d-4f73-a79e-c87c016f69d3_u39znrh4devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:06:34 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Converted 112.00 MB image at 47.84 MB/s Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:34 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef 1G Sep 25 18:06:34 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:34 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d 1073741824" returned: 0 in 0.561s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:34 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d Sep 25 18:06:34 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:34 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d" returned: 0 in 0.277s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7abe072-68d9-42e5-a3b3-c82eb349e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13dfb26-7eed-464a-994d-2108d0822a9d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77378784-a171-4e7a-a035-6fc3ee3372d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:34 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef 1G" returned: 0 in 0.400s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Downloaded image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}])) to volume f31338c2-bcd2-45b3-b8c1-f1d10977e8ef successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Temporary image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 for user 15acc13abfda4125b2dcfbfb4453826b is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Marking volume f31338c2-bcd2-45b3-b8c1-f1d10977e8ef as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:06:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Volume volume-f13dfb26-7eed-464a-994d-2108d0822a9d (f13dfb26-7eed-464a-994d-2108d0822a9d): created successfully Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77378784-a171-4e7a-a035-6fc3ee3372d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (a3803dad-730b-40d4-8767-d1d3c3177435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Copying metadata from image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 to f31338c2-bcd2-45b3-b8c1-f1d10977e8ef. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:06:34 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Creating volume glance metadata for volume f31338c2-bcd2-45b3-b8c1-f1d10977e8ef backed by image cd0f4e7e-b12d-4f73-a79e-c87c016f69d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:06:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-de575517-5076-4988-a912-230d29f28456 tempest-VolumesSnapshotTestJSON-139093961 None] Created volume successfully. Sep 25 18:06:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f978b8f4-3164-437d-862f-e456631b9ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef', 'volume_size': 1, 'image_id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '523ab8c0581e45b9bf65b1605cdec7eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0f4e7e-b12d-4f73-a79e-c87c016f69d3', 'created_at': datetime.datetime(2026, 9, 25, 15, 47, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 47, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0f4e7e-b12d-4f73-a79e-c87c016f69d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e4c3a9-75bd-4795-8d3d-501f4f2cdf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:35 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Volume volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef (f31338c2-bcd2-45b3-b8c1-f1d10977e8ef): created successfully Sep 25 18:06:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e4c3a9-75bd-4795-8d3d-501f4f2cdf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Flow 'volume_create_manager' (b2633a61-de93-4b4c-be1c-be1c3f52fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-58325123-84e0-4471-9ee6-a1ecc3ec6883 tempest-TestShelveInstance-821684494 None] Created volume successfully. Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Creating offline snapshot 6ccfd318-c60e-4a8b-8d97-153473650adc of volume f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc042747-cb7a-4b38-b853-01a42042ced9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:36 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d Sep 25 18:06:36 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:36 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d" returned: 0 in 0.471s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:36 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc 1G Sep 25 18:06:36 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Acquiring lock "cinder-b505d71f-e5d7-46c2-bbf4-17cfa545c364-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Lock "cinder-b505d71f-e5d7-46c2-bbf4-17cfa545c364-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Acquiring lock "cinder-quobyte-b505d71f-e5d7-46c2-bbf4-17cfa545c364" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Lock "cinder-quobyte-b505d71f-e5d7-46c2-bbf4-17cfa545c364" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f495823c-bc91-446f-b25c-e888c2529927]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:37 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc 1G" returned: 0 in 0.586s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13dfb26-7eed-464a-994d-2108d0822a9d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:37 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13dfb26-7eed-464a-994d-2108d0822a9d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc Sep 25 18:06:37 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:37 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 Sep 25 18:06:37 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:37 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13dfb26-7eed-464a-994d-2108d0822a9d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc" returned: 0 in 0.369s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:37 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc is being set with open permissions: ugo+rw Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:37 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc Sep 25 18:06:37 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:37 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364" returned: 0 in 0.514s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:37 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364 Sep 25 18:06:37 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:37 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc" returned: 0 in 0.319s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-807a9378-bf39-4918-bc47-348f9d17d352 req-6029fb84-ef91-4a19-b7b4-791422fff11c tempest-TestShelveInstance-821684494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:38 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info Sep 25 18:06:38 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:38 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b505d71f-e5d7-46c2-bbf4-17cfa545c364" returned: 0 in 0.332s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Lock "cinder-quobyte-b505d71f-e5d7-46c2-bbf4-17cfa545c364" released by "delete_volume" :: held 0.905s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Created reservations ['73348e6b-8c2e-455a-b3ff-a3c7cfa972ce', '94c69c49-8c73-4767-a09c-deaa6aef8940', '252f8b99-72b2-4b41-8396-ee6907033908', '2279fd2c-2d13-4dbc-be10-7e04933e7c6e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:38 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:06:38 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:38 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info" returned: 0 in 0.319s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:38 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info is being set with open permissions: ugo+rw Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:38 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info Sep 25 18:06:38 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:38 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.464s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:06:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Deleted volume successfully. Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d75eb0db-2090-46dd-9f8f-c37cbb1bfa96 tempest-VolumesNegativeTest-1117433083 None] Lock "cinder-b505d71f-e5d7-46c2-bbf4-17cfa545c364-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:38 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.info" returned: 0 in 0.493s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-807a9378-bf39-4918-bc47-348f9d17d352 req-6029fb84-ef91-4a19-b7b4-791422fff11c tempest-TestShelveInstance-821684494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.811s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-807a9378-bf39-4918-bc47-348f9d17d352 req-6029fb84-ef91-4a19-b7b4-791422fff11c tempest-TestShelveInstance-821684494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8713e8a7-5233-4f4e-ba7f-c26849ab0ed9 tempest-VolumesSnapshotTestJSON-139093961 None] Create snapshot completed successfully Sep 25 18:06:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-807a9378-bf39-4918-bc47-348f9d17d352 req-6029fb84-ef91-4a19-b7b4-791422fff11c tempest-TestShelveInstance-821684494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96061608-46e9-417c-8a40-fa310e9727f4', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:06:39 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-807a9378-bf39-4918-bc47-348f9d17d352 req-6029fb84-ef91-4a19-b7b4-791422fff11c tempest-TestShelveInstance-821684494 None] attachment_update completed successfully. Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (5c550c5e-f425-4102-957d-9e4f0a583d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5366ec5c-d496-481e-a6c8-611062c13967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5366ec5c-d496-481e-a6c8-611062c13967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954199090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6011486-9391-41ea-b3a8-e8fe751088b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:06:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6ccfd318-c60e-4a8b-8d97-153473650adc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:06:40Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05597db-6413-4321-9120-a6c432774afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05597db-6413-4321-9120-a6c432774afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bcb097-08f2-4b02-8b42-4d426724eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bcb097-08f2-4b02-8b42-4d426724eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c6011486-9391-41ea-b3a8-e8fe751088b2', 'volume_name': 'volume-c6011486-9391-41ea-b3a8-e8fe751088b2', 'volume_size': 2, 'snapshot_id': '6ccfd318-c60e-4a8b-8d97-153473650adc'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8966fb08-369a-4293-bf91-0614bb95992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8966fb08-369a-4293-bf91-0614bb95992e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa4a429-a69e-48bd-90d5-eede0f1b9c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:40 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Volume c6011486-9391-41ea-b3a8-e8fe751088b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c6011486-9391-41ea-b3a8-e8fe751088b2', 'volume_size': 2, 'snapshot_id': '6ccfd318-c60e-4a8b-8d97-153473650adc'} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-6ccfd318-c60e-4a8b-8d97-153473650adc-c6011486-9391-41ea-b3a8-e8fe751088b2" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-6ccfd318-c60e-4a8b-8d97-153473650adc-c6011486-9391-41ea-b3a8-e8fe751088b2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Creating volume c6011486-9391-41ea-b3a8-e8fe751088b2 from snapshot 6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-c6011486-9391-41ea-b3a8-e8fe751088b2" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-c6011486-9391-41ea-b3a8-e8fe751088b2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] snapshot: 6ccfd318-c60e-4a8b-8d97-153473650adc, volume: c6011486-9391-41ea-b3a8-e8fe751088b2, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c1ad4-82c5-4832-a9f1-b11358ffe1c0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:40 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc Sep 25 18:06:40 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:40 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc" returned: 0 in 0.475s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13dfb26-7eed-464a-994d-2108d0822a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce411f6-3a74-4323-bcf3-70b0c8814fa0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:41 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d Sep 25 18:06:41 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:41 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d" returned: 0 in 0.742s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:06:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:06:41 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:06:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:41 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 Sep 25 18:06:41 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:50 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=50,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:06:50 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=35,cinder:SELECT=42,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:06:52 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2" returned: 0 in 10.385s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:06:52 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Converted 1024.00 MB image at 98.59 MB/s Sep 25 18:06:52 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 is being set with open permissions: ugo+rw Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:52 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 Sep 25 18:06:52 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:52 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2" returned: 0 in 0.297s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-c6011486-9391-41ea-b3a8-e8fe751088b2" released by "_copy_volume_from_snapshot" :: held 12.014s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-6ccfd318-c60e-4a8b-8d97-153473650adc-c6011486-9391-41ea-b3a8-e8fe751088b2" released by "_create_volume_from_snapshot" :: held 12.100s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.117s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa4a429-a69e-48bd-90d5-eede0f1b9c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6011486-9391-41ea-b3a8-e8fe751088b2', 'volume_size': 2, 'snapshot_id': '6ccfd318-c60e-4a8b-8d97-153473650adc'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2004ac7-15b1-4cb0-a243-4aef60c8f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:06:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Volume volume-c6011486-9391-41ea-b3a8-e8fe751088b2 (c6011486-9391-41ea-b3a8-e8fe751088b2): created successfully Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2004ac7-15b1-4cb0-a243-4aef60c8f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:06:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (5c550c5e-f425-4102-957d-9e4f0a583d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:06:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-032ca9fe-892f-45d3-8fb9-a149b5fa5f25 tempest-VolumesSnapshotTestJSON-139093961 None] Created volume successfully. Sep 25 18:06:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-c6011486-9391-41ea-b3a8-e8fe751088b2-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-c6011486-9391-41ea-b3a8-e8fe751088b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-c6011486-9391-41ea-b3a8-e8fe751088b2" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-c6011486-9391-41ea-b3a8-e8fe751088b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4fd151-acc0-4026-ba1d-5836480c1f95]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:54 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 Sep 25 18:06:54 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:54 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2" returned: 0 in 0.444s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:54 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2 Sep 25 18:06:54 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:54 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c6011486-9391-41ea-b3a8-e8fe751088b2" returned: 0 in 0.283s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-c6011486-9391-41ea-b3a8-e8fe751088b2" released by "delete_volume" :: held 0.907s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['af32be3b-327d-4128-b69b-0893e5cdb988', '06d4ccaa-7f15-485d-bd80-aa50d1f9ddf5', 'c131d1a8-996e-4022-97b6-858163a1739e', '133b2781-4400-4e17-8c13-3cbd0105ecde'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:55 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:06:55 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-6ccfd318-c60e-4a8b-8d97-153473650adc-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-6ccfd318-c60e-4a8b-8d97-153473650adc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-f13dfb26-7eed-464a-994d-2108d0822a9d" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-f13dfb26-7eed-464a-994d-2108d0822a9d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-6ccfd318-c60e-4a8b-8d97-153473650adc" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-6ccfd318-c60e-4a8b-8d97-153473650adc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Deleting offline snapshot 6ccfd318-c60e-4a8b-8d97-153473650adc of volume f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:06:55 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] snapshot_file for this snap is: volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.440s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:06:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Deleted volume successfully. Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d182bf71-f5f8-4a75-91d1-100d0355b8e1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5bc13cdb-2ab3-458f-ae1c-f29fa2ace617 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-c6011486-9391-41ea-b3a8-e8fe751088b2-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:55 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc Sep 25 18:06:55 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:06:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:55 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:06:55 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:56 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc" returned: 0 in 0.612s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13dfb26-7eed-464a-994d-2108d0822a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a18c36-2737-4464-afd2-0fe1383dcb80]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:56 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d Sep 25 18:06:56 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:56 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.587s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:06:56 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d" returned: 0 in 0.701s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:56 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc Sep 25 18:06:56 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:57 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc" returned: 0 in 0.535s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:57 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc Sep 25 18:06:57 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:57 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d.6ccfd318-c60e-4a8b-8d97-153473650adc" returned: 0 in 0.439s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-6ccfd318-c60e-4a8b-8d97-153473650adc" released by "_delete_snapshot" :: held 2.473s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-f13dfb26-7eed-464a-994d-2108d0822a9d" released by "delete_snapshot" :: held 2.520s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['417453b6-bc2b-49d4-b562-fb087d2729b5', '3473c7d2-0f22-49f0-a530-95da5baa8491', 'f4e400f7-2349-4f5b-b3e8-4d1ab57ddfdb', 'eed28914-0459-4263-af20-6a4f903f0c14'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:06:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Delete snapshot completed successfully. Sep 25 18:06:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e8dfccb5-3e50-4f3c-a10a-4c90d6cca60a tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-6ccfd318-c60e-4a8b-8d97-153473650adc-delete_snapshot" released by "delete_snapshot" :: held 2.751s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:06:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-f13dfb26-7eed-464a-994d-2108d0822a9d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-f13dfb26-7eed-464a-994d-2108d0822a9d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-f13dfb26-7eed-464a-994d-2108d0822a9d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-f13dfb26-7eed-464a-994d-2108d0822a9d" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38fdc23-1ca0-4d2c-ace2-84ae88bf29e5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:59 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d Sep 25 18:06:59 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:59 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d" returned: 0 in 0.481s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:06:59 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d Sep 25 18:06:59 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:06:59 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f13dfb26-7eed-464a-994d-2108d0822a9d" returned: 0 in 0.317s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:06:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-f13dfb26-7eed-464a-994d-2108d0822a9d" released by "delete_volume" :: held 0.906s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['c653c1ff-371a-4c1a-bb49-6ec761d17fbc', 'd2a6be79-df06-4d77-a66d-3cf2ed29bd94', 'a4c5433b-9c0d-4d5a-b917-c7c0867858df', 'a409ef51-97bb-4be5-860e-3ee2041250d4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:00 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:00 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:00 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Deleted volume successfully. Sep 25 18:07:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30bd0d51-a1bb-4202-b51e-f9499a62b21b tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-f13dfb26-7eed-464a-994d-2108d0822a9d-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (6b2bb593-f869-4b48-9844-0d4b3226838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a14e2-dbc9-4e6b-ad4f-b23d284b6149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a14e2-dbc9-4e6b-ad4f-b23d284b6149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1400274599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:01Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dead134-8fb2-4fc7-a81d-f18f53cb9435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dead134-8fb2-4fc7-a81d-f18f53cb9435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b017d8a-3d36-4d9a-9aef-a89be5871820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b017d8a-3d36-4d9a-9aef-a89be5871820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc', 'volume_name': 'volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b536d2cd-a71d-411e-bc3c-7dfbbc2dcd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b536d2cd-a71d-411e-bc3c-7dfbbc2dcd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f3c768-cd5a-4896-a839-d0fe7c7c448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Volume 7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc', 'volume_size': 1} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1400274599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:01Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Creating volume 7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:07:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:01 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc 1073741824 Sep 25 18:07:01 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:01 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc 1073741824" returned: 0 in 0.561s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:01 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc Sep 25 18:07:01 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:01 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" returned: 0 in 0.268s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:07:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f3c768-cd5a-4896-a839-d0fe7c7c448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c592988-2512-46f9-8b98-4a1f7857fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Volume volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc (7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc): created successfully Sep 25 18:07:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c592988-2512-46f9-8b98-4a1f7857fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (6b2bb593-f869-4b48-9844-0d4b3226838a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-81d3c986-a4b2-4866-a3fa-fb669b0f1071 tempest-VolumesSnapshotTestJSON-139093961 None] Created volume successfully. Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Creating offline snapshot 39ab0030-1a03-408e-a6a8-3a58dc995ed0 of volume 7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a2bb7e-8a5b-403f-9452-41a972e3f1b4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:03 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc Sep 25 18:07:03 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:03 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" returned: 0 in 0.456s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:03 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 1G Sep 25 18:07:03 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:04 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 1G" returned: 0 in 0.471s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:04 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 Sep 25 18:07:04 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:04 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:04 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 is being set with open permissions: ugo+rw Sep 25 18:07:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:04 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 Sep 25 18:07:04 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:04 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:04 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info Sep 25 18:07:04 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:05 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:05 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info is being set with open permissions: ugo+rw Sep 25 18:07:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:05 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info Sep 25 18:07:05 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:05 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.info" returned: 0 in 0.299s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-42ab9b27-084e-4635-b24c-ad14ce1c1ab1 tempest-VolumesSnapshotTestJSON-139093961 None] Create snapshot completed successfully Sep 25 18:07:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (c6c0bfc5-a214-46ce-af3d-ea1466ca79a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc771e4b-d1d0-40fc-af70-0cd0fbe3b626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc771e4b-d1d0-40fc-af70-0cd0fbe3b626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829265041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb90152-b5f2-4801-8353-dacfcc2444cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbcaad3b23f43428b6b128183523cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39ab0030-1a03-408e-a6a8-3a58dc995ed0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:07Z,use_quota=True,user_id='ce7550e9653046afb20b769d14634313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4683f4-9940-4944-9291-ad91ff655741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4683f4-9940-4944-9291-ad91ff655741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e006e21-06d3-45ab-bc6c-3319f071cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e006e21-06d3-45ab-bc6c-3319f071cc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cb90152-b5f2-4801-8353-dacfcc2444cd', 'volume_name': 'volume-3cb90152-b5f2-4801-8353-dacfcc2444cd', 'volume_size': 1, 'snapshot_id': '39ab0030-1a03-408e-a6a8-3a58dc995ed0'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234f7bcf-9757-4728-a67b-7ad80cf6f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234f7bcf-9757-4728-a67b-7ad80cf6f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82058616-425e-4054-bbfd-32ba0fd3e7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Volume 3cb90152-b5f2-4801-8353-dacfcc2444cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cb90152-b5f2-4801-8353-dacfcc2444cd', 'volume_size': 1, 'snapshot_id': '39ab0030-1a03-408e-a6a8-3a58dc995ed0'} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-39ab0030-1a03-408e-a6a8-3a58dc995ed0-3cb90152-b5f2-4801-8353-dacfcc2444cd" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-39ab0030-1a03-408e-a6a8-3a58dc995ed0-3cb90152-b5f2-4801-8353-dacfcc2444cd" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Creating volume 3cb90152-b5f2-4801-8353-dacfcc2444cd from snapshot 39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-3cb90152-b5f2-4801-8353-dacfcc2444cd" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-3cb90152-b5f2-4801-8353-dacfcc2444cd" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] snapshot: 39ab0030-1a03-408e-a6a8-3a58dc995ed0, volume: 3cb90152-b5f2-4801-8353-dacfcc2444cd, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a34be6-f143-4519-a96e-4c7cf022cf90]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:07 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 Sep 25 18:07:07 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:07 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0" returned: 0 in 0.469s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27a4737-04eb-4121-a6dc-86f828f70882]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:07 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc Sep 25 18:07:07 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:08 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" returned: 0 in 0.484s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:07:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:07:08 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:07:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:08 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd Sep 25 18:07:08 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:17 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd" returned: 0 in 8.870s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:07:17 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Converted 1024.00 MB image at 115.42 MB/s Sep 25 18:07:17 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd is being set with open permissions: ugo+rw Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:17 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd Sep 25 18:07:17 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=22,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:07:17 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd" returned: 0 in 0.336s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-3cb90152-b5f2-4801-8353-dacfcc2444cd" released by "_copy_volume_from_snapshot" :: held 10.257s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-39ab0030-1a03-408e-a6a8-3a58dc995ed0-3cb90152-b5f2-4801-8353-dacfcc2444cd" released by "_create_volume_from_snapshot" :: held 10.365s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.385s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82058616-425e-4054-bbfd-32ba0fd3e7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb90152-b5f2-4801-8353-dacfcc2444cd', 'volume_size': 1, 'snapshot_id': '39ab0030-1a03-408e-a6a8-3a58dc995ed0'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac752af3-9b43-4180-b288-2e4f421531bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:17 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Volume volume-3cb90152-b5f2-4801-8353-dacfcc2444cd (3cb90152-b5f2-4801-8353-dacfcc2444cd): created successfully Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac752af3-9b43-4180-b288-2e4f421531bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Flow 'volume_create_manager' (c6c0bfc5-a214-46ce-af3d-ea1466ca79a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5816b76a-c889-48df-82cf-e1e78021c034 tempest-VolumesSnapshotTestJSON-139093961 None] Created volume successfully. Sep 25 18:07:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-84dd3699-e631-46a5-8953-50b21bae58c3 req-26e9860e-663f-40c1-b6c5-063de440d35e tempest-TestShelveInstance-821684494 None] Terminate volume connection completed successfully. Sep 25 18:07:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-84dd3699-e631-46a5-8953-50b21bae58c3 req-26e9860e-663f-40c1-b6c5-063de440d35e tempest-TestShelveInstance-821684494 None] Deleting attachment 96061608-46e9-417c-8a40-fa310e9727f4. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-3cb90152-b5f2-4801-8353-dacfcc2444cd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-3cb90152-b5f2-4801-8353-dacfcc2444cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-3cb90152-b5f2-4801-8353-dacfcc2444cd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-3cb90152-b5f2-4801-8353-dacfcc2444cd" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[10824635-9e44-4ee6-a8a6-72ec252341a0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:18 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd Sep 25 18:07:18 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:18 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:19 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd Sep 25 18:07:19 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:19 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3cb90152-b5f2-4801-8353-dacfcc2444cd" returned: 0 in 0.292s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-3cb90152-b5f2-4801-8353-dacfcc2444cd" released by "delete_volume" :: held 0.779s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['3c538554-156c-4014-83b6-938a2ecd7292', '19e199ba-afdc-42b8-9828-124593449676', 'd9c7f0b2-f26a-42c3-9c45-ab5d1ee04153', 'c5d06fd0-a36c-473b-9e94-c0e876d4af81'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:19 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:19 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-39ab0030-1a03-408e-a6a8-3a58dc995ed0-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-39ab0030-1a03-408e-a6a8-3a58dc995ed0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:19 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-39ab0030-1a03-408e-a6a8-3a58dc995ed0" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Deleted volume successfully. Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-39ab0030-1a03-408e-a6a8-3a58dc995ed0" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Deleting offline snapshot 39ab0030-1a03-408e-a6a8-3a58dc995ed0 of volume 7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] snapshot_file for this snap is: volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d25e4ef3-06b8-4d60-968b-c8aace69e8ff tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-3cb90152-b5f2-4801-8353-dacfcc2444cd-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[201893be-5591-4c1d-bba4-430ab9ed848d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:20 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 Sep 25 18:07:20 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:20 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0" returned: 0 in 0.496s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:07:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed695d5-4957-48a0-818b-5c2da3cb666f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:20 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc Sep 25 18:07:20 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:21 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" returned: 0 in 0.841s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:21 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 Sep 25 18:07:21 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-013ac942-2f9b-40f6-95b0-93be2ab61fe9 req-b955ddcc-70ad-4c12-8aca-fa00746132a6 tempest-TestShelveInstance-821684494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-013ac942-2f9b-40f6-95b0-93be2ab61fe9 req-b955ddcc-70ad-4c12-8aca-fa00746132a6 tempest-TestShelveInstance-821684494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-013ac942-2f9b-40f6-95b0-93be2ab61fe9 req-b955ddcc-70ad-4c12-8aca-fa00746132a6 tempest-TestShelveInstance-821684494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-013ac942-2f9b-40f6-95b0-93be2ab61fe9 req-b955ddcc-70ad-4c12-8aca-fa00746132a6 tempest-TestShelveInstance-821684494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '468100d5-5545-4a12-b16c-005ded744485', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:07:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-013ac942-2f9b-40f6-95b0-93be2ab61fe9 req-b955ddcc-70ad-4c12-8aca-fa00746132a6 tempest-TestShelveInstance-821684494 None] attachment_update completed successfully. Sep 25 18:07:21 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0" returned: 0 in 0.449s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:21 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0 Sep 25 18:07:21 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:22 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc.39ab0030-1a03-408e-a6a8-3a58dc995ed0" returned: 0 in 0.324s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-39ab0030-1a03-408e-a6a8-3a58dc995ed0" released by "_delete_snapshot" :: held 2.280s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" released by "delete_snapshot" :: held 2.333s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:22 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['7ca1c2de-9d93-468a-adb7-614949b55d23', '4c4a0bbe-82e3-468d-867d-b5731aa2d9d8', '323bd4d6-5e28-4e82-a466-6d6f585657d9', '6bd430d1-eeeb-4456-baf9-a986f32c4475'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Delete snapshot completed successfully. Sep 25 18:07:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-51e0bd6b-8667-4cf6-92f9-4ce8511cc86d tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-39ab0030-1a03-408e-a6a8-3a58dc995ed0-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a446b4ad-cd0b-4b27-991c-bf097a0922ce]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:23 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc Sep 25 18:07:23 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:23 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" returned: 0 in 0.706s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:24 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc Sep 25 18:07:24 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:24 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" returned: 0 in 0.468s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc" released by "delete_volume" :: held 1.277s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['7217ca01-7d5b-4a58-a30d-14b5156ca46f', 'c26637e7-11ce-4836-b165-edad3559238b', 'c602219c-8420-4572-aa90-52440766ff5f', 'b1458f87-6e88-44bd-93c6-94d16f9409ea'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:24 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:24 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:25 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.399s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Deleted volume successfully. Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c6208e15-045a-4cac-956f-9319c74d2beb tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-7beaa98c-b44f-44d3-9d21-dedc7fe2c5cc-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-9595b7db-d385-4611-bf7d-c3622959a6a4-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-9595b7db-d385-4611-bf7d-c3622959a6a4-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "cinder-quobyte-9595b7db-d385-4611-bf7d-c3622959a6a4" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-9595b7db-d385-4611-bf7d-c3622959a6a4" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0382074a-d2ee-445e-bab0-ca1608f9997c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:26 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 Sep 25 18:07:26 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:26 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4" returned: 0 in 0.681s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:26 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4 Sep 25 18:07:26 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:27 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9595b7db-d385-4611-bf7d-c3622959a6a4" returned: 0 in 0.612s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-quobyte-9595b7db-d385-4611-bf7d-c3622959a6a4" released by "delete_volume" :: held 1.460s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Created reservations ['20d78297-4389-4f46-9f54-fa0f8204baa7', 'ba00cafa-83d8-4868-a36b-77e0224cd64a', 'b95f2e33-b364-47ab-a587-b8ef22a11f66', 'e69df377-310c-4c47-a054-d58bab7a3e4c'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:27 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:27 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:27 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.332s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Deleted volume successfully. Sep 25 18:07:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07d30ccc-2775-4a63-9429-a287c05b0148 tempest-VolumesSnapshotTestJSON-139093961 None] Lock "cinder-9595b7db-d385-4611-bf7d-c3622959a6a4-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:37 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=33,cinder:INSERT=8,cinder:SELECT=31,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:07:37 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Flow 'volume_create_manager' (2387fed7-d465-435e-a53e-ced9cd5f8089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe6bd4b-4763-4034-a8ab-f5cb905553ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe6bd4b-4763-4034-a8ab-f5cb905553ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67490f97-5d3e-46fb-b1bc-24befa2f84d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d642691de8c48a8aec146b18e5f2464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:41Z,use_quota=True,user_id='19c28f9dcbf54cfbae7e3182b23eb014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61db8f51-e314-4664-a5e9-a2be2d931442),volume_type_id=61db8f51-e314-4664-a5e9-a2be2d931442)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038ca0a3-ca06-4e3a-a58e-41e250e72a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038ca0a3-ca06-4e3a-a58e-41e250e72a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a9200-6db4-44b2-a338-5b1493189bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a9200-6db4-44b2-a338-5b1493189bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67490f97-5d3e-46fb-b1bc-24befa2f84d9', 'volume_name': 'volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9', 'volume_size': 1, 'image_id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa4165c1-ea15-441f-babd-486a6394f5a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7543aa5ff3779efa2f5ba1ed42132b4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d642691de8c48a8aec146b18e5f2464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e39cc1f7559387f645bf874efafe0d7b03fddcb515bdf378d21ec3c3bf0a1bedca845b864e97fdf7ed560816a9282fa2b0b2d9225e3b4e41fa2e352fe41e78c2', 'id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'created_at': datetime.datetime(2026, 9, 25, 16, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 7, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa4165c1-ea15-441f-babd-486a6394f5a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5466ccc-dd30-478f-9a9b-5da6a033eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5466ccc-dd30-478f-9a9b-5da6a033eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4bd90b-b1d0-458c-acfe-8ff186b429b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:41 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Volume 67490f97-5d3e-46fb-b1bc-24befa2f84d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9', 'volume_size': 1, 'image_id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa4165c1-ea15-441f-babd-486a6394f5a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7543aa5ff3779efa2f5ba1ed42132b4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d642691de8c48a8aec146b18e5f2464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e39cc1f7559387f645bf874efafe0d7b03fddcb515bdf378d21ec3c3bf0a1bedca845b864e97fdf7ed560816a9282fa2b0b2d9225e3b4e41fa2e352fe41e78c2', 'id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'created_at': datetime.datetime(2026, 9, 25, 16, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 7, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa4165c1-ea15-441f-babd-486a6394f5a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Trying to clone 67490f97-5d3e-46fb-b1bc-24befa2f84d9 from image aa4165c1-ea15-441f-babd-486a6394f5a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa4165c1-ea15-441f-babd-486a6394f5a7', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:07:41 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Image download 0.00 MB at 0.00 MB/s Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[82590db3-19ac-498c-882c-6fd41bdff017]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:41 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD Sep 25 18:07:41 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:42 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:42 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD Sep 25 18:07:42 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:42 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Temporary image aa4165c1-ea15-441f-babd-486a6394f5a7 is fetched for user 19c28f9dcbf54cfbae7e3182b23eb014. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4be8d4-c869-4105-aca2-c1055ecde56e]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:42 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD Sep 25 18:07:42 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:42 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:42 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD Sep 25 18:07:42 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:43 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD" returned: 1 in 0.339s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67490f97-5d3e-46fb-b1bc-24befa2f84d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d642691de8c48a8aec146b18e5f2464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:41Z,use_quota=True,user_id='19c28f9dcbf54cfbae7e3182b23eb014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61db8f51-e314-4664-a5e9-a2be2d931442),volume_type_id=61db8f51-e314-4664-a5e9-a2be2d931442)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Creating volume 67490f97-5d3e-46fb-b1bc-24befa2f84d9 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:07:43 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:43 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 1073741824 Sep 25 18:07:43 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:43 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 1073741824" returned: 0 in 0.427s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:43 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 Sep 25 18:07:43 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:43 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:43 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Attempting download of aa4165c1-ea15-441f-babd-486a6394f5a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa4165c1-ea15-441f-babd-486a6394f5a7', 'metadata': {}}])) to volume 67490f97-5d3e-46fb-b1bc-24befa2f84d9. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a53705-a9e9-4924-88dc-da9fedbd0ea4]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:44 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq Sep 25 18:07:44 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:44 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq" returned: 0 in 0.359s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:44 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq Sep 25 18:07:44 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:44 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq" returned: 1 in 0.354s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4165c1-ea15-441f-babd-486a6394f5a7_4t_wvmtq' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[084e175e-65fb-4183-b5a2-c42fe2014a02]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:44 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD Sep 25 18:07:44 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:45 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:45 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD Sep 25 18:07:45 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:45 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD" returned: 1 in 0.393s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:07:45 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] aa4165c1-ea15-441f-babd-486a6394f5a7 was raw, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:07:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:45 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 Sep 25 18:07:45 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:46 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9" returned: 0 in 0.560s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa4165c1-ea15-441f-babd-486a6394f5a7_badh01t0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:07:46 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:46 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 1G Sep 25 18:07:46 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:46 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 1G" returned: 0 in 0.351s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Downloaded image aa4165c1-ea15-441f-babd-486a6394f5a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa4165c1-ea15-441f-babd-486a6394f5a7', 'metadata': {}}])) to volume 67490f97-5d3e-46fb-b1bc-24befa2f84d9 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Temporary image aa4165c1-ea15-441f-babd-486a6394f5a7 for user 19c28f9dcbf54cfbae7e3182b23eb014 is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Marking volume 67490f97-5d3e-46fb-b1bc-24befa2f84d9 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Copying metadata from image aa4165c1-ea15-441f-babd-486a6394f5a7 to 67490f97-5d3e-46fb-b1bc-24befa2f84d9. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Creating volume glance metadata for volume 67490f97-5d3e-46fb-b1bc-24befa2f84d9 backed by image aa4165c1-ea15-441f-babd-486a6394f5a7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7543aa5ff3779efa2f5ba1ed42132b4d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4bd90b-b1d0-458c-acfe-8ff186b429b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9', 'volume_size': 1, 'image_id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa4165c1-ea15-441f-babd-486a6394f5a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7543aa5ff3779efa2f5ba1ed42132b4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d642691de8c48a8aec146b18e5f2464', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e39cc1f7559387f645bf874efafe0d7b03fddcb515bdf378d21ec3c3bf0a1bedca845b864e97fdf7ed560816a9282fa2b0b2d9225e3b4e41fa2e352fe41e78c2', 'id': 'aa4165c1-ea15-441f-babd-486a6394f5a7', 'created_at': datetime.datetime(2026, 9, 25, 16, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 7, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa4165c1-ea15-441f-babd-486a6394f5a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba5a1e9-33f0-44ea-8ed1-5171e20b9bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:46 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Volume volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 (67490f97-5d3e-46fb-b1bc-24befa2f84d9): created successfully Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba5a1e9-33f0-44ea-8ed1-5171e20b9bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Flow 'volume_create_manager' (2387fed7-d465-435e-a53e-ced9cd5f8089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2a17be3b-45bc-4592-bf22-0e44dd082735 tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Created volume successfully. Sep 25 18:07:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Acquiring lock "cinder-67490f97-5d3e-46fb-b1bc-24befa2f84d9-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "cinder-67490f97-5d3e-46fb-b1bc-24befa2f84d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Acquiring lock "cinder-quobyte-67490f97-5d3e-46fb-b1bc-24befa2f84d9" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "cinder-quobyte-67490f97-5d3e-46fb-b1bc-24befa2f84d9" acquired by "delete_volume" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:47 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c55d58-9c2f-4241-8770-ef451b1e41d9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:47 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 Sep 25 18:07:47 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:48 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9" returned: 0 in 0.378s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:48 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9 Sep 25 18:07:48 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:48 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-67490f97-5d3e-46fb-b1bc-24befa2f84d9" returned: 0 in 0.268s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "cinder-quobyte-67490f97-5d3e-46fb-b1bc-24befa2f84d9" released by "delete_volume" :: held 0.703s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:48 devstack cinder-volume[86665]: WARNING cinder.quota [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:07:48 devstack cinder-volume[86665]: WARNING cinder.quota [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Created reservations ['b415be64-fcde-4dc8-8f42-49eca6b5de35', 'e0ccea8d-1f83-489c-b654-720daa7ba563', 'ea9e8878-8cc8-4aa9-8bbd-03729b19da04', 'a12c2bfa-2e68-4cb4-91ac-87132162ad12'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:48 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:48 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:48 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.242s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Deleted volume successfully. Sep 25 18:07:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-35bd37f0-3a51-4db0-8d49-7cdb8b1c4b7f tempest-VolumeAndVolumeTypeFromImageTest-736891246 None] Lock "cinder-67490f97-5d3e-46fb-b1bc-24befa2f84d9-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Flow 'volume_create_manager' (12cf5cdd-e910-4b20-9dfc-f9ca4c3e63b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd99ce7-03c9-4599-a834-66268a9dce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd99ce7-03c9-4599-a834-66268a9dce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-699545303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee68f1e0-e863-450e-bbcd-dd1a3e2593e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221312bd98e641b8a1474f823da0fbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:50Z,use_quota=True,user_id='4f50385c6a294f7b8d62fa415e6a3eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f396dda-2043-4bba-9162-b7bdf9def1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f396dda-2043-4bba-9162-b7bdf9def1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debc8af4-b945-4ec3-92c2-8f0728401fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debc8af4-b945-4ec3-92c2-8f0728401fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee68f1e0-e863-450e-bbcd-dd1a3e2593e7', 'volume_name': 'volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d131094-f6ec-4016-8c49-3ee65d6aff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d131094-f6ec-4016-8c49-3ee65d6aff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117445c1-d955-4c9b-9b4c-19ed32e99ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Volume ee68f1e0-e863-450e-bbcd-dd1a3e2593e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7', 'volume_size': 1} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-699545303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee68f1e0-e863-450e-bbcd-dd1a3e2593e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221312bd98e641b8a1474f823da0fbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:07:50Z,use_quota=True,user_id='4f50385c6a294f7b8d62fa415e6a3eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Creating volume ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:07:50 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:50 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 1073741824 Sep 25 18:07:50 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:50 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 1073741824" returned: 0 in 0.483s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:51 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 Sep 25 18:07:51 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:51 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7" returned: 0 in 0.263s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117445c1-d955-4c9b-9b4c-19ed32e99ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5455b7c-a5b4-4efd-9105-4689b2356874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:07:51 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Volume volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 (ee68f1e0-e863-450e-bbcd-dd1a3e2593e7): created successfully Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5455b7c-a5b4-4efd-9105-4689b2356874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:07:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Flow 'volume_create_manager' (12cf5cdd-e910-4b20-9dfc-f9ca4c3e63b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:07:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2c32a519-9fca-43e6-aece-be90316df218 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Created volume successfully. Sep 25 18:07:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-49c0a1a7-f1bb-4243-8331-8a37ec9e03f5 req-bcaee6ae-5bc7-43c6-8a6a-8d22dd6fc715 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-49c0a1a7-f1bb-4243-8331-8a37ec9e03f5 req-bcaee6ae-5bc7-43c6-8a6a-8d22dd6fc715 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-49c0a1a7-f1bb-4243-8331-8a37ec9e03f5 req-bcaee6ae-5bc7-43c6-8a6a-8d22dd6fc715 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:53 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-49c0a1a7-f1bb-4243-8331-8a37ec9e03f5 req-bcaee6ae-5bc7-43c6-8a6a-8d22dd6fc715 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0530a0f0-76e2-406e-86b4-492685613ce5', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:07:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-49c0a1a7-f1bb-4243-8331-8a37ec9e03f5 req-bcaee6ae-5bc7-43c6-8a6a-8d22dd6fc715 tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] attachment_update completed successfully. Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:55 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:55 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:56 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.280s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:07:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:07:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:07:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-68fa4103-4812-4fa8-b54f-ac51b7e31176 req-1f25812c-94c5-4628-af66-7576e61eff1b tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Terminate volume connection completed successfully. Sep 25 18:07:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-68fa4103-4812-4fa8-b54f-ac51b7e31176 req-1f25812c-94c5-4628-af66-7576e61eff1b tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Deleting attachment 0530a0f0-76e2-406e-86b4-492685613ce5. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:07:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Acquiring lock "cinder-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "cinder-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Acquiring lock "cinder-quobyte-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:07:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "cinder-quobyte-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:07:58 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51a729b-7213-4e22-8f1c-88e67fdeda91]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:07:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:58 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 Sep 25 18:07:58 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:59 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7" returned: 0 in 0.384s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:59 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7 Sep 25 18:07:59 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:59 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "cinder-quobyte-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7" released by "delete_volume" :: held 0.697s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Created reservations ['22dd24d3-4d4e-495a-a1a3-e446958dd68f', '48e061c9-7e9f-47a9-9c8c-8b2f9cad47b2', 'c366f60d-0ba7-4a80-a658-3cb9a28f83b3', 'eb7f1c36-f87c-4b4e-9fb7-be2b04ebaba2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:07:59 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:07:59 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:07:59 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.281s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:07:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Deleted volume successfully. Sep 25 18:07:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-148db198-3568-4df3-9810-39eb44966c8e tempest-TestServerVolumeAttachScenarioOldVersion-53307915 None] Lock "cinder-ee68f1e0-e863-450e-bbcd-dd1a3e2593e7-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:09 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:08:09 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=24,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:08:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-007a5237-306f-4886-9187-2924a250c8cd tempest-TestShelveInstance-821684494 None] Terminate volume connection completed successfully. Sep 25 18:08:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-007a5237-306f-4886-9187-2924a250c8cd tempest-TestShelveInstance-821684494 None] Deleting attachment 468100d5-5545-4a12-b16c-005ded744485. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Acquiring lock "cinder-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Lock "cinder-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Acquiring lock "cinder-quobyte-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Lock "cinder-quobyte-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608337d-5cfa-4b43-9dd2-2c3a8161c345]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:12 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef Sep 25 18:08:12 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:12 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" returned: 0 in 0.588s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:12 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef Sep 25 18:08:12 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:13 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" returned: 0 in 0.290s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Lock "cinder-quobyte-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef" released by "delete_volume" :: held 0.957s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG cinder.quota [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Created reservations ['8bbb900f-c345-4304-9d2b-4e33073e5681', 'a06b4cc5-1523-4406-b76c-0f7e835d99a2', '8bdc4c77-3fdd-4ddf-9940-4ba1c1168117', '5c3a82b3-b0be-4d18-98f3-5449057a1e88'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:13 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:08:13 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:13 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.281s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG cinder.manager [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:08:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Deleted volume successfully. Sep 25 18:08:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [req-cfc3f002-cc21-4f54-a4ac-4804f7f7b413 req-7ebadefb-39fd-4ae3-b7d0-fbad393909e9 tempest-TestShelveInstance-821684494 None] Lock "cinder-f31338c2-bcd2-45b3-b8c1-f1d10977e8ef-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Flow 'volume_create_manager' (86bf0953-eac7-4247-ab1c-27b41ba456e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33c44ad-3480-406b-8cde-8fbf6fbf45e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33c44ad-3480-406b-8cde-8fbf6fbf45e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-649092441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbb58ce-d1e1-40c6-b5c8-9384c0517f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab499c6cc3345dc97058cbf66fce140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:08:19Z,use_quota=True,user_id='0edc96b94dfc410eb7d0e987083f911f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d39e8f6-b967-4492-a085-a7e48942dfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d39e8f6-b967-4492-a085-a7e48942dfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a149058e-8338-4211-90b7-0a845f9ad879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a149058e-8338-4211-90b7-0a845f9ad879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbb58ce-d1e1-40c6-b5c8-9384c0517f12', 'volume_name': 'volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3746767a-84af-467a-93db-be9f786e078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3746767a-84af-467a-93db-be9f786e078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dbf529-9929-48c6-8ade-5825c5e258ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Volume 4bbb58ce-d1e1-40c6-b5c8-9384c0517f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12', 'volume_size': 1} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-649092441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbb58ce-d1e1-40c6-b5c8-9384c0517f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab499c6cc3345dc97058cbf66fce140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:08:19Z,use_quota=True,user_id='0edc96b94dfc410eb7d0e987083f911f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Creating volume 4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:08:19 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:19 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 1073741824 Sep 25 18:08:19 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:19 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 1073741824" returned: 0 in 0.533s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:19 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 Sep 25 18:08:19 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:20 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dbf529-9929-48c6-8ade-5825c5e258ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c90607b-010b-4a7f-a782-cbe6c8f050b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:20 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Volume volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 (4bbb58ce-d1e1-40c6-b5c8-9384c0517f12): created successfully Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c90607b-010b-4a7f-a782-cbe6c8f050b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Flow 'volume_create_manager' (86bf0953-eac7-4247-ab1c-27b41ba456e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:08:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6c6f5c9a-60cc-4171-a836-7600b054cd62 tempest-SnapshotDependencyTests-1460594766 None] Created volume successfully. Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Creating offline snapshot 91963cac-7733-450b-9bd8-570e3d1407ed of volume 4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e3cc19-4916-4753-81d8-c21dab5911b5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:21 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 Sep 25 18:08:21 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:21 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" returned: 0 in 0.483s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:21 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed 1G Sep 25 18:08:21 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:22 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed 1G" returned: 0 in 0.576s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:22 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed Sep 25 18:08:22 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:22 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed" returned: 0 in 0.347s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:22 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed is being set with open permissions: ugo+rw Sep 25 18:08:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:22 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed Sep 25 18:08:22 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:23 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:23 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info Sep 25 18:08:23 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:23 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info" returned: 0 in 0.276s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:23 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info is being set with open permissions: ugo+rw Sep 25 18:08:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:23 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info Sep 25 18:08:23 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:23 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.info" returned: 0 in 0.270s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:23 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-da016205-9463-4834-8e2a-ff1144014809 tempest-SnapshotDependencyTests-1460594766 None] Create snapshot completed successfully Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Flow 'volume_create_manager' (ec4b0542-90e7-4f56-82ba-d04dda337b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7075872e-946e-4507-a58a-526844f70d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7075872e-946e-4507-a58a-526844f70d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f144738-2ca8-4cea-9a2d-f13e33780666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab499c6cc3345dc97058cbf66fce140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=91963cac-7733-450b-9bd8-570e3d1407ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:08:25Z,use_quota=True,user_id='0edc96b94dfc410eb7d0e987083f911f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d9d3b-e3d2-4202-97a1-27a815a481a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d9d3b-e3d2-4202-97a1-27a815a481a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd5d363-914e-4cef-a5f6-502adcd84af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd5d363-914e-4cef-a5f6-502adcd84af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f144738-2ca8-4cea-9a2d-f13e33780666', 'volume_name': 'volume-6f144738-2ca8-4cea-9a2d-f13e33780666', 'volume_size': 1, 'snapshot_id': '91963cac-7733-450b-9bd8-570e3d1407ed'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42461c41-b568-47eb-aa07-e45ec80f4611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42461c41-b568-47eb-aa07-e45ec80f4611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88bf579-e1c9-452a-980b-4e00b88ebd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Volume 6f144738-2ca8-4cea-9a2d-f13e33780666: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f144738-2ca8-4cea-9a2d-f13e33780666', 'volume_size': 1, 'snapshot_id': '91963cac-7733-450b-9bd8-570e3d1407ed'} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-quobyte-91963cac-7733-450b-9bd8-570e3d1407ed-6f144738-2ca8-4cea-9a2d-f13e33780666" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-91963cac-7733-450b-9bd8-570e3d1407ed-6f144738-2ca8-4cea-9a2d-f13e33780666" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Creating volume 6f144738-2ca8-4cea-9a2d-f13e33780666 from snapshot 91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-quobyte-6f144738-2ca8-4cea-9a2d-f13e33780666" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-6f144738-2ca8-4cea-9a2d-f13e33780666" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] snapshot: 91963cac-7733-450b-9bd8-570e3d1407ed, volume: 6f144738-2ca8-4cea-9a2d-f13e33780666, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e38d5d-58e1-4ecf-b37b-6d85d685c201]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:25 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed Sep 25 18:08:25 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:25 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed" returned: 0 in 0.471s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e152c-e287-42e5-b9cb-fffc2427dab0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:26 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 Sep 25 18:08:26 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:26 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" returned: 0 in 0.502s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:08:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:08:26 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:08:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:26 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 Sep 25 18:08:26 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:34 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666" returned: 0 in 8.246s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:34 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:08:34 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Converted 1024.00 MB image at 124.16 MB/s Sep 25 18:08:34 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 is being set with open permissions: ugo+rw Sep 25 18:08:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:34 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 Sep 25 18:08:34 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:35 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666" returned: 0 in 0.292s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-6f144738-2ca8-4cea-9a2d-f13e33780666" released by "_copy_volume_from_snapshot" :: held 9.628s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-91963cac-7733-450b-9bd8-570e3d1407ed-6f144738-2ca8-4cea-9a2d-f13e33780666" released by "_create_volume_from_snapshot" :: held 9.715s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.734s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88bf579-e1c9-452a-980b-4e00b88ebd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f144738-2ca8-4cea-9a2d-f13e33780666', 'volume_size': 1, 'snapshot_id': '91963cac-7733-450b-9bd8-570e3d1407ed'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6688b7e-cf52-439b-95ea-7999d2029a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:08:35 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Volume volume-6f144738-2ca8-4cea-9a2d-f13e33780666 (6f144738-2ca8-4cea-9a2d-f13e33780666): created successfully Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6688b7e-cf52-439b-95ea-7999d2029a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Flow 'volume_create_manager' (ec4b0542-90e7-4f56-82ba-d04dda337b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:08:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ef964e53-daec-451e-aae4-33d0d5104d33 tempest-SnapshotDependencyTests-1460594766 None] Created volume successfully. Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-91963cac-7733-450b-9bd8-570e3d1407ed-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-91963cac-7733-450b-9bd8-570e3d1407ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-quobyte-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-quobyte-91963cac-7733-450b-9bd8-570e3d1407ed" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-91963cac-7733-450b-9bd8-570e3d1407ed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Deleting offline snapshot 91963cac-7733-450b-9bd8-570e3d1407ed of volume 4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] snapshot_file for this snap is: volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b597ee-9e8b-4f9c-b61e-99a53cbc6d74]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:36 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed Sep 25 18:08:36 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:36 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed" returned: 0 in 0.496s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:08:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c1e385-4d63-4526-b8bc-ed5514ef1f86]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:36 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 Sep 25 18:08:36 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:37 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" returned: 0 in 0.715s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:37 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed Sep 25 18:08:37 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:37 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed" returned: 0 in 0.439s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:37 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed Sep 25 18:08:37 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:37 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12.91963cac-7733-450b-9bd8-570e3d1407ed" returned: 0 in 0.299s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-91963cac-7733-450b-9bd8-570e3d1407ed" released by "_delete_snapshot" :: held 2.106s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" released by "delete_snapshot" :: held 2.136s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:38 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Created reservations ['2471b133-de5b-4005-9059-279c4f81055c', 'd2ce48f6-a97d-49f4-a43f-9456c491b206', '264237f4-4c63-4d60-afda-b5bcf1c2a588', '2008253b-9dc8-4b60-801d-9862655f2559'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:08:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Delete snapshot completed successfully. Sep 25 18:08:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19cc1ef0-96ce-4a46-8b5a-75d30e08b456 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-91963cac-7733-450b-9bd8-570e3d1407ed-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-quobyte-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17816a4-2685-4cd8-b115-252057bc925d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:39 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 Sep 25 18:08:39 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:39 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" returned: 0 in 0.436s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:39 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12 Sep 25 18:08:39 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:39 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" returned: 0 in 0.307s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12" released by "delete_volume" :: held 0.837s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Created reservations ['1a8341bc-1ced-4b40-be71-5b0cc83f7263', 'bab6f19c-cff0-4e06-9925-5c9cb530354a', '5d38ebb8-fe50-4ea7-a7fa-3c1429afe956', '20a508f3-a4ea-4122-a53c-ffbfcd610ba3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:40 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:08:40 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-6f144738-2ca8-4cea-9a2d-f13e33780666-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-6f144738-2ca8-4cea-9a2d-f13e33780666-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "cinder-quobyte-6f144738-2ca8-4cea-9a2d-f13e33780666" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-6f144738-2ca8-4cea-9a2d-f13e33780666" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047127c-16fe-4ff0-894e-ff61904426a1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:40 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.369s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:08:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Deleted volume successfully. Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-95e24d92-0274-4178-bc78-dfd1299d90b2 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-4bbb58ce-d1e1-40c6-b5c8-9384c0517f12-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:40 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 Sep 25 18:08:40 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:40 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666" returned: 0 in 0.461s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:40 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666 Sep 25 18:08:40 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:41 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6f144738-2ca8-4cea-9a2d-f13e33780666" returned: 0 in 0.280s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-quobyte-6f144738-2ca8-4cea-9a2d-f13e33780666" released by "delete_volume" :: held 0.801s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Created reservations ['98f17dd5-1d79-46d2-bcac-4fb5418a1a15', '0d99d29a-a437-42cd-8bbb-b0cf313212d8', '2bf1c3bd-61c3-4ee1-9882-6e810da843be', '9af73840-8b89-4d4b-b9ad-c6b2fe4e070e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:41 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:08:41 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:41 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:08:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Deleted volume successfully. Sep 25 18:08:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53b1f18a-ca9f-47f6-83a2-4210e9707b73 tempest-SnapshotDependencyTests-1460594766 None] Lock "cinder-6f144738-2ca8-4cea-9a2d-f13e33780666-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:08:51 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=24,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:08:51 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=38,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:08:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:08:55 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:08:55 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:08:56 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 25 18:08:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.353s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:08:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:08:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:08:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:08:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:09:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "cinder-726bb16a-043e-4c24-b58c-41bf16b336ad-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-726bb16a-043e-4c24-b58c-41bf16b336ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "cinder-quobyte-726bb16a-043e-4c24-b58c-41bf16b336ad" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-quobyte-726bb16a-043e-4c24-b58c-41bf16b336ad" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:00 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a748d43f-088b-468b-910f-291471d20bdf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:00 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad Sep 25 18:09:00 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:01 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad" returned: 0 in 0.511s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:01 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad Sep 25 18:09:01 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:01 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-726bb16a-043e-4c24-b58c-41bf16b336ad" returned: 0 in 0.283s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-quobyte-726bb16a-043e-4c24-b58c-41bf16b336ad" released by "delete_volume" :: held 0.850s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Created reservations ['ca0935a1-38fc-4178-966a-3a5873eef2e7', '3425fe03-f8fa-4904-9081-6c8a5a1253ba', '1c1eb765-92de-46fd-9213-2380e14bed6b', '75d0f847-bcb7-482b-a90a-d866e9a4195e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:01 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:09:01 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "cinder-8287f121-5478-4069-928b-0c5780694164-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-8287f121-5478-4069-928b-0c5780694164-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "cinder-quobyte-8287f121-5478-4069-928b-0c5780694164" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-quobyte-8287f121-5478-4069-928b-0c5780694164" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[775fc448-a14d-4059-bff7-b8d34f749a64]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:02 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.346s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:09:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Deleted volume successfully. Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-17e33961-6d06-4969-b534-ea4c1a068509 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-726bb16a-043e-4c24-b58c-41bf16b336ad-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:02 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 Sep 25 18:09:02 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:02 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164" returned: 0 in 0.479s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:02 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164 Sep 25 18:09:02 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:02 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8287f121-5478-4069-928b-0c5780694164" returned: 0 in 0.328s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-quobyte-8287f121-5478-4069-928b-0c5780694164" released by "delete_volume" :: held 0.878s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Created reservations ['34d2f193-857d-4e90-8624-798b46a7aea6', 'c41c6048-4993-4f21-b36a-3282856cd3fe', '8eed8861-e9c5-4b9e-8e42-be6d043be09c', 'b1484c22-80e9-4901-ad6c-263a2d46e19a'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:02 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:09:02 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:03 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:03 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:09:03 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Deleted volume successfully. Sep 25 18:09:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d988368-b895-4af9-9a01-d5ec3dce0154 tempest-TestServerVolumeAttachmentScenario-368996325 None] Lock "cinder-8287f121-5478-4069-928b-0c5780694164-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:03 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Flow 'volume_create_manager' (0e5a7ba1-6a32-4431-a3b9-c92e9a26ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfea3a3-fd48-422b-8c14-b5cd95b3f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfea3a3-fd48-422b-8c14-b5cd95b3f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1459660548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34491aae2ea74cf6b8330e71607e5f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:04Z,use_quota=True,user_id='6b236dc2e0d9428fbefbcd7658aba52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c3376-a0f8-48e5-a9f6-437fd88e65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c3376-a0f8-48e5-a9f6-437fd88e65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fcf8c4-1af1-4bf0-bf3c-dbc8b3f35cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fcf8c4-1af1-4bf0-bf3c-dbc8b3f35cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f', 'volume_name': 'volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9d735d-9d3a-49ff-94b9-2354668fce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9d735d-9d3a-49ff-94b9-2354668fce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6865ca3a-2120-487b-b5d3-381613208bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:04 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Volume 48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f', 'volume_size': 1} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1459660548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34491aae2ea74cf6b8330e71607e5f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:04Z,use_quota=True,user_id='6b236dc2e0d9428fbefbcd7658aba52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Creating volume 48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:04 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:04 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f 1073741824 Sep 25 18:09:04 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:04 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f 1073741824" returned: 0 in 0.583s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:04 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f Sep 25 18:09:04 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:05 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" returned: 0 in 0.306s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6865ca3a-2120-487b-b5d3-381613208bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b61b4d-cb5e-4630-be00-1b5b3f9e7eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:05 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Volume volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f (48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f): created successfully Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b61b4d-cb5e-4630-be00-1b5b3f9e7eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Flow 'volume_create_manager' (0e5a7ba1-6a32-4431-a3b9-c92e9a26ea39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c0dc5b63-3573-4fee-a0e5-7be0cae4c2dc tempest-TestStampPattern-1161401935 None] Created volume successfully. Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Flow 'volume_create_manager' (6bf852cb-4374-4947-89b9-0acb7697bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2071421-0020-48d1-8fd3-831da0c1716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2071421-0020-48d1-8fd3-831da0c1716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1194913744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bd6e9c-96f7-4081-b46e-17e493df1982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb6477f27db4d459308e618712f468f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:06Z,use_quota=True,user_id='b61c3ef4771a467d843968758ba741fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365913ad-e1ea-467b-94a0-d49a13ebe058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365913ad-e1ea-467b-94a0-d49a13ebe058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37d2145-0b05-45e0-b35c-fc48f04cdb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37d2145-0b05-45e0-b35c-fc48f04cdb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77bd6e9c-96f7-4081-b46e-17e493df1982', 'volume_name': 'volume-77bd6e9c-96f7-4081-b46e-17e493df1982', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2716a4f9-7489-4564-83ce-079f24a2b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2716a4f9-7489-4564-83ce-079f24a2b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad20290-5faa-4fba-b765-9caa0840bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:06 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Volume 77bd6e9c-96f7-4081-b46e-17e493df1982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77bd6e9c-96f7-4081-b46e-17e493df1982', 'volume_size': 1} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1194913744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bd6e9c-96f7-4081-b46e-17e493df1982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb6477f27db4d459308e618712f468f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:06Z,use_quota=True,user_id='b61c3ef4771a467d843968758ba741fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Creating volume 77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:06 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:06 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 1073741824 Sep 25 18:09:06 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:06 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 1073741824" returned: 0 in 0.566s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:06 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 Sep 25 18:09:06 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:07 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982" returned: 0 in 0.288s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad20290-5faa-4fba-b765-9caa0840bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77bd6e9c-96f7-4081-b46e-17e493df1982', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9fe46c-1e5e-414d-bf28-be0ccc6252b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:07 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Volume volume-77bd6e9c-96f7-4081-b46e-17e493df1982 (77bd6e9c-96f7-4081-b46e-17e493df1982): created successfully Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9fe46c-1e5e-414d-bf28-be0ccc6252b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:07 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Flow 'volume_create_manager' (6bf852cb-4374-4947-89b9-0acb7697bd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:07 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-60e65562-8f5e-4493-a1c3-6987b37a7fd0 tempest-TestImageHashVerification-2129867580 None] Created volume successfully. Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28859ff-f5e3-4644-8d7e-c404a3704eb0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:10 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 Sep 25 18:09:10 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:10 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a8f6d4-6a20-4d71-a1ff-ae40bd44de42]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:10 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 Sep 25 18:09:10 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:10 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 /opt/stack/data/cinder/conversion/77bd6e9c-96f7-4081-b46e-17e493df1982.temp_image.3bbc6e4f-8bbf-46e2-970d-f9f07ef447332xgjidbx.img {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:10 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 /opt/stack/data/cinder/conversion/77bd6e9c-96f7-4081-b46e-17e493df1982.temp_image.3bbc6e4f-8bbf-46e2-970d-f9f07ef447332xgjidbx.img Sep 25 18:09:10 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:17 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=26,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:09:20 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:09:20 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 /opt/stack/data/cinder/conversion/77bd6e9c-96f7-4081-b46e-17e493df1982.temp_image.3bbc6e4f-8bbf-46e2-970d-f9f07ef447332xgjidbx.img" returned: 0 in 10.005s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2019e-e5ec-4759-a114-6fd523970f79]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:21 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 Sep 25 18:09:21 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:21 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982" returned: 0 in 0.715s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:21 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982, size 1024.00 MB, duration 10.01 sec, destination /opt/stack/data/cinder/conversion/77bd6e9c-96f7-4081-b46e-17e493df1982.temp_image.3bbc6e4f-8bbf-46e2-970d-f9f07ef447332xgjidbx.img {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:09:21 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Converted 1024.00 MB image at 102.32 MB/s Sep 25 18:09:21 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] 3bbc6e4f-8bbf-46e2-970d-f9f07ef44733 was raw, no need to convert to raw {{(pid=86665) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Flow 'volume_create_manager' (f95c50d5-4468-4e33-bf87-df5dd5d81ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e983f050-1c0d-4d54-a27e-8d7c78d4871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e983f050-1c0d-4d54-a27e-8d7c78d4871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071216528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3cc50d-3827-4362-b117-5d950ffd7cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24a90d8bcb147538bc6c7d1b1d9a358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:24Z,use_quota=True,user_id='b6aefc09d0f54540b3db9f27b04d35bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da82f18b-fe8c-48b3-a160-ffd5721186b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da82f18b-fe8c-48b3-a160-ffd5721186b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677bf91a-eecf-41e8-937c-f9ff3b3ed05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677bf91a-eecf-41e8-937c-f9ff3b3ed05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3cc50d-3827-4362-b117-5d950ffd7cb4', 'volume_name': 'volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a566b34-dad5-4c0a-884d-d4ab1f2fcedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a566b34-dad5-4c0a-884d-d4ab1f2fcedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf8b0d3-d86a-4c63-ab0e-be3574166d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Volume 6b3cc50d-3827-4362-b117-5d950ffd7cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4', 'volume_size': 1} Sep 25 18:09:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:34 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:09:34 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=2 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.401s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Uploaded volume to glance image-id: 3bbc6e4f-8bbf-46e2-970d-f9f07ef44733. {{(pid=86665) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.871s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071216528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3cc50d-3827-4362-b117-5d950ffd7cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24a90d8bcb147538bc6c7d1b1d9a358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:24Z,use_quota=True,user_id='b6aefc09d0f54540b3db9f27b04d35bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Creating volume 6b3cc50d-3827-4362-b117-5d950ffd7cb4 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:41 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:41 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 1073741824 Sep 25 18:09:41 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dff9ea81-c8ca-4df5-8905-161952e01f9d tempest-TestImageHashVerification-2129867580 None] Copy volume to image completed successfully. Sep 25 18:09:41 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 1073741824" returned: 0 in 0.447s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:41 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 Sep 25 18:09:41 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:42 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf8b0d3-d86a-4c63-ab0e-be3574166d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811732bc-f840-4cbd-b18f-783135adc060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:42 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Volume volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 (6b3cc50d-3827-4362-b117-5d950ffd7cb4): created successfully Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811732bc-f840-4cbd-b18f-783135adc060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Flow 'volume_create_manager' (f95c50d5-4468-4e33-bf87-df5dd5d81ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:42 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e142b5be-00f6-43aa-b488-f75bf1f72e15 tempest-ProjectReaderTests-160670737 None] Created volume successfully. Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Acquiring lock "cinder-77bd6e9c-96f7-4081-b46e-17e493df1982-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Lock "cinder-77bd6e9c-96f7-4081-b46e-17e493df1982-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Acquiring lock "cinder-quobyte-77bd6e9c-96f7-4081-b46e-17e493df1982" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Lock "cinder-quobyte-77bd6e9c-96f7-4081-b46e-17e493df1982" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e15f57-7a3f-445e-a4a2-9566f9cf7e15]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:42 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 Sep 25 18:09:42 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Acquiring lock "cinder-6b3cc50d-3827-4362-b117-5d950ffd7cb4-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Lock "cinder-6b3cc50d-3827-4362-b117-5d950ffd7cb4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Acquiring lock "cinder-quobyte-6b3cc50d-3827-4362-b117-5d950ffd7cb4" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Lock "cinder-quobyte-6b3cc50d-3827-4362-b117-5d950ffd7cb4" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b6c42b-c356-4007-97e8-6888904bbb4d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:42 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:42 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 Sep 25 18:09:42 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982" returned: 0 in 0.451s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:42 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982 Sep 25 18:09:42 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:43 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4" returned: 0 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:43 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-77bd6e9c-96f7-4081-b46e-17e493df1982" returned: 0 in 0.300s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:43 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4 Sep 25 18:09:43 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Lock "cinder-quobyte-77bd6e9c-96f7-4081-b46e-17e493df1982" released by "delete_volume" :: held 0.800s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Created reservations ['55fbb759-6f77-4d27-b26e-13d88d7500da', '7a1411b0-c176-4097-a997-54e2e4fc3720', 'acb7a277-9dda-48c3-a565-736bf9a569ba', '93b248b1-e363-4f1b-b9f2-abbd18e33112'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:43 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:09:43 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:43 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-6b3cc50d-3827-4362-b117-5d950ffd7cb4" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Lock "cinder-quobyte-6b3cc50d-3827-4362-b117-5d950ffd7cb4" released by "delete_volume" :: held 0.816s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Created reservations ['d1ce89c5-eca6-42eb-aba5-b11bbdf1ae83', '6b661ab4-44a9-4e74-a80f-c5c8909bda06', '97316664-e26c-428b-bc40-4619e10dcc97', '9dca8bc0-046f-404b-8682-eb1a42d35306'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-100d44f9-5571-4d33-81a8-7c9779cb5cab req-dc21361d-9986-4594-99d4-445a27fbbaf7 tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-100d44f9-5571-4d33-81a8-7c9779cb5cab req-dc21361d-9986-4594-99d4-445a27fbbaf7 tempest-TestStampPattern-1161401935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-100d44f9-5571-4d33-81a8-7c9779cb5cab req-dc21361d-9986-4594-99d4-445a27fbbaf7 tempest-TestStampPattern-1161401935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:43 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.288s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:09:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Deleted volume successfully. Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-100d44f9-5571-4d33-81a8-7c9779cb5cab req-dc21361d-9986-4594-99d4-445a27fbbaf7 tempest-TestStampPattern-1161401935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f689a98a-0ddf-433d-8d02-6a4e33572670', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:43 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:09:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0ed982e1-5bba-4b45-ab97-1b12e15f7c1d tempest-TestImageHashVerification-2129867580 None] Lock "cinder-77bd6e9c-96f7-4081-b46e-17e493df1982-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:43 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-100d44f9-5571-4d33-81a8-7c9779cb5cab req-dc21361d-9986-4594-99d4-445a27fbbaf7 tempest-TestStampPattern-1161401935 None] attachment_update completed successfully. Sep 25 18:09:43 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.346s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:09:44 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Deleted volume successfully. Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ad0bf877-e181-474e-a7cd-56d7a9b75042 tempest-ProjectReaderTests-160670737 None] Lock "cinder-6b3cc50d-3827-4362-b117-5d950ffd7cb4-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Flow 'volume_create_manager' (92c1d54e-c461-4c8a-a1da-1445686d5f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d628b6d-6a2e-4144-bcee-68b6ff685140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d628b6d-6a2e-4144-bcee-68b6ff685140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101949777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b45a999-17cd-4f35-ae4c-5caf4de7ffb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24a90d8bcb147538bc6c7d1b1d9a358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:44Z,use_quota=True,user_id='b6aefc09d0f54540b3db9f27b04d35bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3262f4-b3c4-41ea-bc39-50324908fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3262f4-b3c4-41ea-bc39-50324908fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b05d4b8-e934-4c33-9698-5486426b9828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b05d4b8-e934-4c33-9698-5486426b9828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b45a999-17cd-4f35-ae4c-5caf4de7ffb3', 'volume_name': 'volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f695dac3-88cd-4e96-8d48-8abe9b1e11bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f695dac3-88cd-4e96-8d48-8abe9b1e11bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169e3729-b1a2-4a43-acbc-edc504686646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:44 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Volume 3b45a999-17cd-4f35-ae4c-5caf4de7ffb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3', 'volume_size': 1} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101949777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b45a999-17cd-4f35-ae4c-5caf4de7ffb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f24a90d8bcb147538bc6c7d1b1d9a358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:44Z,use_quota=True,user_id='b6aefc09d0f54540b3db9f27b04d35bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Creating volume 3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:44 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:44 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 1073741824 Sep 25 18:09:44 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:45 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 1073741824" returned: 0 in 0.604s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:45 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 Sep 25 18:09:45 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:45 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3" returned: 0 in 0.257s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169e3729-b1a2-4a43-acbc-edc504686646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2866261c-ebdf-4afe-91fa-a5011d13734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:45 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Volume volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 (3b45a999-17cd-4f35-ae4c-5caf4de7ffb3): created successfully Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2866261c-ebdf-4afe-91fa-a5011d13734e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Flow 'volume_create_manager' (92c1d54e-c461-4c8a-a1da-1445686d5f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:45 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9fe5e377-e51f-46a5-9eb2-35452ef4ed35 tempest-ProjectReaderTests-160670737 None] Created volume successfully. Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Acquiring lock "cinder-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Lock "cinder-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Acquiring lock "cinder-quobyte-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Lock "cinder-quobyte-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d06e45-094d-4afc-8022-1d338e3b022c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:46 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 Sep 25 18:09:46 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:46 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3" returned: 0 in 0.380s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:47 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3 Sep 25 18:09:47 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:47 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Lock "cinder-quobyte-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3" released by "delete_volume" :: held 0.799s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Created reservations ['445b8d01-d16c-4493-85ce-ae43dc3be9db', '865e0639-ff0a-4332-b165-18a2a4f67088', '1a17ea48-9f36-4a09-af2a-314c1f4af37a', 'b2714e01-38a7-4b86-8eb4-24403ae84115'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:47 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:09:47 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:47 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.338s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:09:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Deleted volume successfully. Sep 25 18:09:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e16ce63e-f1a1-416a-b537-a23b16827e20 tempest-ProjectReaderTests-160670737 None] Lock "cinder-3b45a999-17cd-4f35-ae4c-5caf4de7ffb3-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:09:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-a2967f4c-3a95-4958-9f65-8c5a6acd7e00 req-b91905eb-b118-4ae7-84d9-311ea78e16bf tempest-TestStampPattern-1161401935 None] Terminate volume connection completed successfully. Sep 25 18:09:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-a2967f4c-3a95-4958-9f65-8c5a6acd7e00 req-b91905eb-b118-4ae7-84d9-311ea78e16bf tempest-TestStampPattern-1161401935 None] Deleting attachment f689a98a-0ddf-433d-8d02-6a4e33572670. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Creating offline snapshot 1dabc29f-1673-44f9-95cb-f8354728fde6 of volume 48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb381b85-ec2e-4057-8d48-c4311be51570]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:50 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f Sep 25 18:09:50 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:50 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" returned: 0 in 0.405s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:50 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 1G Sep 25 18:09:50 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:51 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 1G" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:51 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 Sep 25 18:09:51 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:51 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6" returned: 0 in 0.308s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:51 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 is being set with open permissions: ugo+rw Sep 25 18:09:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:51 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 Sep 25 18:09:51 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:51 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6" returned: 0 in 0.276s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:51 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info Sep 25 18:09:51 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:52 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info" returned: 0 in 0.242s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:52 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info is being set with open permissions: ugo+rw Sep 25 18:09:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:52 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info Sep 25 18:09:52 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:52 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.info" returned: 0 in 0.239s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5ca1d778-46a4-47c1-99e0-a95c3e7ac2de tempest-TestStampPattern-1161401935 None] Create snapshot completed successfully Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:55 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:09:55 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:56 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.275s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:09:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:09:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:09:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (c2d6f603-3990-48d7-82ce-fbd2e237a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471af381-5463-415c-beab-efcfd305262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471af381-5463-415c-beab-efcfd305262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1757108207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:57Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004e60b8-22cc-4594-b385-736d58ec31d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004e60b8-22cc-4594-b385-736d58ec31d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ae6d12-88d3-47f4-ad1a-4ca0d0beaa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ae6d12-88d3-47f4-ad1a-4ca0d0beaa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa', 'volume_name': 'volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dfe03a-fb8f-4fef-876d-898d3e1d9a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dfe03a-fb8f-4fef-876d-898d3e1d9a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae5f34b-45cd-4d4e-9d0e-dac2dd7ec69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Volume 5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa', 'volume_size': 1} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1757108207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:57Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Creating volume 5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:57 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:57 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa 1073741824 Sep 25 18:09:57 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (f60cc56b-cebb-4bf4-9b50-dfd71afbcd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfa67a6-ec08-4c86-b6bd-fe592e520e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfa67a6-ec08-4c86-b6bd-fe592e520e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760734083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff0b1fd-598a-4d0e-b241-5339289b2e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:58Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4026af5-7f78-419a-a607-65b1f54826a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4026af5-7f78-419a-a607-65b1f54826a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e877005d-6692-41bf-9a89-379945565699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e877005d-6692-41bf-9a89-379945565699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff0b1fd-598a-4d0e-b241-5339289b2e25', 'volume_name': 'volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0f3ae8-5f87-440a-9900-0f90ad9a7c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0f3ae8-5f87-440a-9900-0f90ad9a7c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf54e13-06be-4f31-b1e6-a285984abfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:57 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Volume 0ff0b1fd-598a-4d0e-b241-5339289b2e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25', 'volume_size': 1} Sep 25 18:09:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:58 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa 1073741824" returned: 0 in 0.632s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:58 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa Sep 25 18:09:58 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (32f35707-50bb-4361-9920-eb05cce0717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57946d01-2fd8-479d-9e87-9aae6537b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57946d01-2fd8-479d-9e87-9aae6537b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431307761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308d8095-aa9b-411d-8790-f5a4430b6dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:58Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5139cb4-210a-4492-8604-d97fdccbf71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5139cb4-210a-4492-8604-d97fdccbf71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91584ae7-836b-4bbd-a9f5-bacc8dbd9e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91584ae7-836b-4bbd-a9f5-bacc8dbd9e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308d8095-aa9b-411d-8790-f5a4430b6dff', 'volume_name': 'volume-308d8095-aa9b-411d-8790-f5a4430b6dff', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b273438a-cd85-4060-819c-c7b9dbdcb650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b273438a-cd85-4060-819c-c7b9dbdcb650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbca627-9c9a-469b-a2d7-d6aba7173687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Volume 308d8095-aa9b-411d-8790-f5a4430b6dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308d8095-aa9b-411d-8790-f5a4430b6dff', 'volume_size': 1} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:58 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa" returned: 0 in 0.301s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760734083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff0b1fd-598a-4d0e-b241-5339289b2e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:58Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Creating volume 0ff0b1fd-598a-4d0e-b241-5339289b2e25 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:58 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae5f34b-45cd-4d4e-9d0e-dac2dd7ec69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:58 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 1073741824 Sep 25 18:09:58 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddd78c5-6e6b-49e3-b331-bd0160133ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Volume volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa (5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa): created successfully Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddd78c5-6e6b-49e3-b331-bd0160133ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (c2d6f603-3990-48d7-82ce-fbd2e237a183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7ce228a3-37d0-4ec3-8286-9427d1f9c706 tempest-CreateVolumesFromImageTest-1007297575 None] Created volume successfully. Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (ece16a1a-eb4a-4211-82cd-2efb2d6d38e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3b04ca-1d8d-493c-a77c-17dbadbedb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3b04ca-1d8d-493c-a77c-17dbadbedb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1706030453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c894f542-56d7-4e62-bbd6-920c1517747b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:59Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbd32e5-a2ba-4aac-bc02-8101e1cf3383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbd32e5-a2ba-4aac-bc02-8101e1cf3383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392e5d61-1ad8-4dc1-a811-b71bdfae5eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392e5d61-1ad8-4dc1-a811-b71bdfae5eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c894f542-56d7-4e62-bbd6-920c1517747b', 'volume_name': 'volume-c894f542-56d7-4e62-bbd6-920c1517747b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4581031-d82a-46ce-aab2-51a5880592fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4581031-d82a-46ce-aab2-51a5880592fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b31ebb-0ae1-49ff-a168-3294fced6113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Volume c894f542-56d7-4e62-bbd6-920c1517747b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c894f542-56d7-4e62-bbd6-920c1517747b', 'volume_size': 1} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:59 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 1073741824" returned: 0 in 0.532s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:59 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 Sep 25 18:09:59 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (8670a1f5-63e2-43c4-9c75-2c4edb868b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4d1553-a9b1-4d09-9525-5f4c1bbfc41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4d1553-a9b1-4d09-9525-5f4c1bbfc41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1470794748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd967b8-8c86-49bf-8af2-4446aad71d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:59Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c10f6f-3b17-4ecd-8ca9-d196621c2657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c10f6f-3b17-4ecd-8ca9-d196621c2657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b89701f-68b4-4b5b-abea-3e6e45f0d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b89701f-68b4-4b5b-abea-3e6e45f0d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd967b8-8c86-49bf-8af2-4446aad71d48', 'volume_name': 'volume-9fd967b8-8c86-49bf-8af2-4446aad71d48', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588b7576-282e-45db-b646-6ea7c752461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588b7576-282e-45db-b646-6ea7c752461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14a878e-0f92-497e-b045-1257fea5c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Volume 9fd967b8-8c86-49bf-8af2-4446aad71d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd967b8-8c86-49bf-8af2-4446aad71d48', 'volume_size': 1} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25" returned: 0 in 0.284s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431307761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308d8095-aa9b-411d-8790-f5a4430b6dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:58Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Creating volume 308d8095-aa9b-411d-8790-f5a4430b6dff {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:09:59 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf54e13-06be-4f31-b1e6-a285984abfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff 1073741824 Sep 25 18:09:59 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9611b026-ffb4-47b9-835b-ab34d0a29a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:09:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Volume volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 (0ff0b1fd-598a-4d0e-b241-5339289b2e25): created successfully Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9611b026-ffb4-47b9-835b-ab34d0a29a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (f60cc56b-cebb-4bf4-9b50-dfd71afbcd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:09:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c1da8798-1475-4add-8330-9d237161e599 tempest-CreateVolumesFromImageTest-1007297575 None] Created volume successfully. Sep 25 18:09:59 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff 1073741824" returned: 0 in 0.445s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:09:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:00 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff Sep 25 18:10:00 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:00 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff" returned: 0 in 0.275s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1706030453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c894f542-56d7-4e62-bbd6-920c1517747b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:59Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Creating volume c894f542-56d7-4e62-bbd6-920c1517747b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:00 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbca627-9c9a-469b-a2d7-d6aba7173687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308d8095-aa9b-411d-8790-f5a4430b6dff', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a40ca59-e358-4613-af9a-b3bff2e26992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:00 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b 1073741824 Sep 25 18:10:00 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Volume volume-308d8095-aa9b-411d-8790-f5a4430b6dff (308d8095-aa9b-411d-8790-f5a4430b6dff): created successfully Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a40ca59-e358-4613-af9a-b3bff2e26992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (32f35707-50bb-4361-9920-eb05cce0717c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c4f2b1c3-6e47-4ada-afbf-54bba009cfdb tempest-CreateVolumesFromImageTest-1007297575 None] Created volume successfully. Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Flow 'volume_create_manager' (9a8e6ad2-3e36-4020-912e-1f0f744a5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5860d8-6b40-4c2c-90e1-caf511c53dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5860d8-6b40-4c2c-90e1-caf511c53dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-954564866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34491aae2ea74cf6b8330e71607e5f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1dabc29f-1673-44f9-95cb-f8354728fde6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:00Z,use_quota=True,user_id='6b236dc2e0d9428fbefbcd7658aba52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcba0aa5-513c-4b84-9287-bf442eb3e0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcba0aa5-513c-4b84-9287-bf442eb3e0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14377a6e-1ffa-4533-90cb-9aef6908d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14377a6e-1ffa-4533-90cb-9aef6908d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c', 'volume_name': 'volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c', 'volume_size': 1, 'snapshot_id': '1dabc29f-1673-44f9-95cb-f8354728fde6'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ade8a5a-4e34-4af7-af3a-3bbb61628e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ade8a5a-4e34-4af7-af3a-3bbb61628e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246efde4-203f-4ac4-a05c-de82bbf92d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Volume 7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c', 'volume_size': 1, 'snapshot_id': '1dabc29f-1673-44f9-95cb-f8354728fde6'} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:00 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b 1073741824" returned: 0 in 0.499s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:00 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b Sep 25 18:10:00 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:01 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1470794748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd967b8-8c86-49bf-8af2-4446aad71d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6522432a9e49d68633d1e8925a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:09:59Z,use_quota=True,user_id='06a1ae0f49d94972a6aefb9c9bfe9a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Creating volume 9fd967b8-8c86-49bf-8af2-4446aad71d48 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:01 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b31ebb-0ae1-49ff-a168-3294fced6113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c894f542-56d7-4e62-bbd6-920c1517747b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28837ac6-09c5-4b1f-9db0-0ae96cd8dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:01 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 1073741824 Sep 25 18:10:01 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Volume volume-c894f542-56d7-4e62-bbd6-920c1517747b (c894f542-56d7-4e62-bbd6-920c1517747b): created successfully Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28837ac6-09c5-4b1f-9db0-0ae96cd8dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (ece16a1a-eb4a-4211-82cd-2efb2d6d38e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6da3fd4a-bd06-43be-b7fc-0a9b6bb160bc tempest-CreateVolumesFromImageTest-1007297575 None] Created volume successfully. Sep 25 18:10:01 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 1073741824" returned: 0 in 0.496s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:01 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 Sep 25 18:10:01 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:01 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48" returned: 0 in 0.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.272s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-quobyte-1dabc29f-1673-44f9-95cb-f8354728fde6-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14a878e-0f92-497e-b045-1257fea5c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd967b8-8c86-49bf-8af2-4446aad71d48', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd09b68-b77b-4b3b-be10-723feba80702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-1dabc29f-1673-44f9-95cb-f8354728fde6-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Creating volume 7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c from snapshot 1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-quobyte-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Volume volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 (9fd967b8-8c86-49bf-8af2-4446aad71d48): created successfully Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd09b68-b77b-4b3b-be10-723feba80702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Flow 'volume_create_manager' (8670a1f5-63e2-43c4-9c75-2c4edb868b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:01 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] snapshot: 1dabc29f-1673-44f9-95cb-f8354728fde6, volume: 7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:10:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a9a73f9e-cbfd-444a-9f49-1f201e18b6ea tempest-CreateVolumesFromImageTest-1007297575 None] Created volume successfully. Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[459979b4-61e2-45c1-b488-4bc74ad69038]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:02 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 Sep 25 18:10:02 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:02 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6" returned: 0 in 0.399s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a811d6-6055-454c-a826-b5c59ac30af4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:02 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f Sep 25 18:10:02 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:02 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" returned: 0 in 0.444s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:10:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:02 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c Sep 25 18:10:02 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-9fd967b8-8c86-49bf-8af2-4446aad71d48-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-9fd967b8-8c86-49bf-8af2-4446aad71d48-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-quobyte-9fd967b8-8c86-49bf-8af2-4446aad71d48" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-9fd967b8-8c86-49bf-8af2-4446aad71d48" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8301aa2-2a4d-424f-b424-c0d2d4a018df]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:03 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 Sep 25 18:10:03 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:03 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48" returned: 0 in 0.646s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:03 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48 Sep 25 18:10:03 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:04 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd967b8-8c86-49bf-8af2-4446aad71d48" returned: 0 in 0.786s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-9fd967b8-8c86-49bf-8af2-4446aad71d48" released by "delete_volume" :: held 1.525s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:04 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Created reservations ['d6d4c58b-ae7c-4756-83fd-e8488bb4a208', 'da719371-9fd7-4c4f-80c7-91e08bec082a', '23a6b1c7-21b1-4e1c-acd5-bbe81c275297', 'a5d067f5-4272-490a-9f64-7bf2129de80b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:05 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:05 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:05 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.436s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Deleted volume successfully. Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a4bb4903-0fb7-4548-bad2-8ac36626c4bb tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-9fd967b8-8c86-49bf-8af2-4446aad71d48-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-c894f542-56d7-4e62-bbd6-920c1517747b-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-c894f542-56d7-4e62-bbd6-920c1517747b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-quobyte-c894f542-56d7-4e62-bbd6-920c1517747b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-c894f542-56d7-4e62-bbd6-920c1517747b" acquired by "delete_volume" :: waited 0.044s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[219badd5-5278-4d37-b27c-44dbc41ad3c1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:06 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b Sep 25 18:10:06 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:06 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b" returned: 0 in 0.822s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:06 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b Sep 25 18:10:06 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:07 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c894f542-56d7-4e62-bbd6-920c1517747b" returned: 0 in 0.598s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-c894f542-56d7-4e62-bbd6-920c1517747b" released by "delete_volume" :: held 1.553s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Created reservations ['c22e6a76-54d3-4e20-9c02-09f1677a1777', '6f842b37-af39-440f-906e-83c3ad77d473', '4923414a-32ff-4e38-b2f5-c740f6816a1f', 'c697f94e-8e54-42af-8437-ec3fae609755'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:07 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:07 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-308d8095-aa9b-411d-8790-f5a4430b6dff-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-308d8095-aa9b-411d-8790-f5a4430b6dff-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:08 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.501s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Deleted volume successfully. Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-quobyte-308d8095-aa9b-411d-8790-f5a4430b6dff" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ecadb739-a994-4bdb-94db-91730b49f576 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-c894f542-56d7-4e62-bbd6-920c1517747b-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-308d8095-aa9b-411d-8790-f5a4430b6dff" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edd7147-8474-4b13-a42e-b09ec0d94004]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:08 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff Sep 25 18:10:08 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:09 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff" returned: 0 in 0.682s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:09 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff Sep 25 18:10:09 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:10 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-308d8095-aa9b-411d-8790-f5a4430b6dff" returned: 0 in 0.870s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-308d8095-aa9b-411d-8790-f5a4430b6dff" released by "delete_volume" :: held 1.703s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Created reservations ['bab30490-4187-40e8-9856-49de0d659801', '88caa8d1-e232-4061-9ed1-78c0d61db8cd', '480ad2ca-24af-40c4-a10b-ec660e6b2c93', '037b3c07-46c9-4e90-82da-6c3f7d7b8719'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:10 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:10 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-0ff0b1fd-598a-4d0e-b241-5339289b2e25-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-0ff0b1fd-598a-4d0e-b241-5339289b2e25-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-quobyte-0ff0b1fd-598a-4d0e-b241-5339289b2e25" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-0ff0b1fd-598a-4d0e-b241-5339289b2e25" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:11 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.673s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Deleted volume successfully. Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[af33b39d-4f89-488a-9ca8-a00cb06a296c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-299e9ffd-5d99-4649-bdb8-b9b93a1e3d00 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-308d8095-aa9b-411d-8790-f5a4430b6dff-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:11 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 Sep 25 18:10:11 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:12 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25" returned: 0 in 0.916s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:12 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25 Sep 25 18:10:12 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:12 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0ff0b1fd-598a-4d0e-b241-5339289b2e25" returned: 0 in 0.640s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-0ff0b1fd-598a-4d0e-b241-5339289b2e25" released by "delete_volume" :: held 1.750s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:12 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" returned: 0 in 10.061s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f, size 1024.00 MB, duration 10.06 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:10:12 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Converted 1024.00 MB image at 101.76 MB/s Sep 25 18:10:12 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c is being set with open permissions: ugo+rw Sep 25 18:10:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:13 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c Sep 25 18:10:13 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Created reservations ['d7c1ace1-88b1-49bf-aff8-1e9fa2b64c97', 'c942ab36-ba25-4e3b-a020-1dfd9557c206', '475ba06f-7d4e-4ddd-a60d-21e18a952613', '1d2ae6ef-d84a-460c-b996-fa6d98630b24'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:13 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:13 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:13 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" returned: 0 in 0.263s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" released by "_copy_volume_from_snapshot" :: held 11.278s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-1dabc29f-1673-44f9-95cb-f8354728fde6-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" released by "_create_volume_from_snapshot" :: held 11.381s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.412s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246efde4-203f-4ac4-a05c-de82bbf92d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c', 'volume_size': 1, 'snapshot_id': '1dabc29f-1673-44f9-95cb-f8354728fde6'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4259584-d052-4f4e-bc59-57029beee8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Volume volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c (7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c): created successfully Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4259584-d052-4f4e-bc59-57029beee8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Flow 'volume_create_manager' (9a8e6ad2-3e36-4020-912e-1f0f744a5fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:13 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.279s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Deleted volume successfully. Sep 25 18:10:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cbebbca0-7937-4bbe-b263-0e131b9372ba tempest-TestStampPattern-1161401935 None] Created volume successfully. Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a45022bd-a284-487e-8b57-9df850f5869f tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-0ff0b1fd-598a-4d0e-b241-5339289b2e25-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "cinder-quobyte-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e04860-590d-4417-9109-828008358f05]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:13 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa Sep 25 18:10:13 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:13 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa" returned: 0 in 0.394s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:13 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa Sep 25 18:10:13 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:14 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa" returned: 0 in 0.326s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-quobyte-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa" released by "delete_volume" :: held 0.770s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Created reservations ['c6dccf3b-1925-494a-a873-fde55278a90a', 'b0f1bd5d-161f-4b83-8bfe-b125ac9ac4cf', 'de41852b-cc28-4d33-b085-7da8fa1fd0f0', '54dcc10c-598b-4ded-9bf3-1074fb3c3d3c'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:14 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:14 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:14 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.273s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Deleted volume successfully. Sep 25 18:10:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7847a03a-7e0b-4af6-b1cd-e19c047478d3 tempest-CreateVolumesFromImageTest-1007297575 None] Lock "cinder-5e3dc1ad-25e1-4c41-bc9c-be1c1bed62fa-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (d428e2fc-55d2-4455-aebb-35128010fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828137ed-0d3c-49ba-8a2e-bee1f158070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828137ed-0d3c-49ba-8a2e-bee1f158070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828364021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:18Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e34f9ee-e283-41e7-acd6-08941211b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e34f9ee-e283-41e7-acd6-08941211b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37183a8-550f-4ef4-bd24-0e57ebf88a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37183a8-550f-4ef4-bd24-0e57ebf88a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9', 'volume_name': 'volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f931849f-8d68-45cb-bccb-0b294b8c0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f931849f-8d68-45cb-bccb-0b294b8c0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e07ff9-ada6-48f8-8ae3-4947eca1b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:17 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume 5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9', 'volume_size': 1} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828364021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:18Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating volume 5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:17 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:17 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 1073741824 Sep 25 18:10:17 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:18 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 1073741824" returned: 0 in 0.535s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:18 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 Sep 25 18:10:18 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:18 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" returned: 0 in 0.287s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e07ff9-ada6-48f8-8ae3-4947eca1b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4dc00b-1b0f-4870-9776-470670d75565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:18 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 (5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9): created successfully Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4dc00b-1b0f-4870-9776-470670d75565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (d428e2fc-55d2-4455-aebb-35128010fd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9d76ab30-87b5-4428-b0b5-de0bca78fd77 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created volume successfully. Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating offline snapshot 6a51e93f-19f2-492e-ac31-63c92bbddb8f of volume 5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dec8d0e-678d-4313-850c-c0ad2fd52c72]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:20 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 Sep 25 18:10:20 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:20 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" returned: 0 in 0.380s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:20 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f 1G Sep 25 18:10:20 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:20 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f 1G" returned: 0 in 0.392s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:20 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f Sep 25 18:10:20 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:21 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f" returned: 0 in 0.299s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:21 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f is being set with open permissions: ugo+rw Sep 25 18:10:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:21 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f Sep 25 18:10:21 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:21 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:21 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info Sep 25 18:10:21 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:21 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info" returned: 0 in 0.265s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:21 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info is being set with open permissions: ugo+rw Sep 25 18:10:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:21 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info Sep 25 18:10:21 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:22 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.info" returned: 0 in 0.272s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6d3010a6-8f39-4124-8151-9cb55c0ea174 tempest-CreateVolumesFromSnapshotTest-471728151 None] Create snapshot completed successfully Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (5334dc31-f8fa-463b-ad87-80ad69bde5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d60dd61-2301-4c9e-9062-c2fea91d505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d60dd61-2301-4c9e-9062-c2fea91d505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726937591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74f098-2416-472f-8cdd-7aa5bdaa74bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:23Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea46c9e-7428-45ca-82fb-4ed50b5fe83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea46c9e-7428-45ca-82fb-4ed50b5fe83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8de3502-2c13-4537-8df5-726e92cbf122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8de3502-2c13-4537-8df5-726e92cbf122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d74f098-2416-472f-8cdd-7aa5bdaa74bd', 'volume_name': 'volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0eddff4-0b14-4137-aead-a79d3cdf3fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0eddff4-0b14-4137-aead-a79d3cdf3fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca11e5b-5608-403a-ae4a-3a5e293bfed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:22 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume 5d74f098-2416-472f-8cdd-7aa5bdaa74bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd', 'volume_size': 1} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726937591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74f098-2416-472f-8cdd-7aa5bdaa74bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:23Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating volume 5d74f098-2416-472f-8cdd-7aa5bdaa74bd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:22 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:22 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd 1073741824 Sep 25 18:10:22 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (dcf06306-ba26-4e91-ad09-83b3d6a6c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049e2f69-2bc9-4de3-bd86-4672f89ceb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049e2f69-2bc9-4de3-bd86-4672f89ceb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-370646427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8433b35f-637f-4bff-99cb-1140d848b89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:23Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ead249-a8ab-4455-8f3f-a07d3acfec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ead249-a8ab-4455-8f3f-a07d3acfec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e875a-135c-4571-a5a6-96ae4cdf1032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e875a-135c-4571-a5a6-96ae4cdf1032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8433b35f-637f-4bff-99cb-1140d848b89e', 'volume_name': 'volume-8433b35f-637f-4bff-99cb-1140d848b89e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc2cb3e-56d1-4429-8091-6429f39861ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc2cb3e-56d1-4429-8091-6429f39861ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74975999-ca9b-46e1-a310-0b83d9d0830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume 8433b35f-637f-4bff-99cb-1140d848b89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8433b35f-637f-4bff-99cb-1140d848b89e', 'volume_size': 1} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:23 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd 1073741824" returned: 0 in 0.640s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:23 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd Sep 25 18:10:23 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (d657456a-2a92-44d1-af2b-9225e68c8b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f441be76-9355-43b4-8c66-bd5c1ca1e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f441be76-9355-43b4-8c66-bd5c1ca1e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264395150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd3c90d-239f-4c53-81ca-cd849958d5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:24Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc08503f-8f1c-4816-9b85-9530ea69590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc08503f-8f1c-4816-9b85-9530ea69590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60acfbb7-a398-4b20-8896-ffa8d1847427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60acfbb7-a398-4b20-8896-ffa8d1847427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd3c90d-239f-4c53-81ca-cd849958d5dc', 'volume_name': 'volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0498cef-bc9f-4700-b611-67412a58fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0498cef-bc9f-4700-b611-67412a58fecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872ebb0-ca6e-4241-b8b5-7362ad77108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume cdd3c90d-239f-4c53-81ca-cd849958d5dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc', 'volume_size': 1} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:23 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-370646427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8433b35f-637f-4bff-99cb-1140d848b89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:23Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating volume 8433b35f-637f-4bff-99cb-1140d848b89e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:23 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca11e5b-5608-403a-ae4a-3a5e293bfed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39493e89-1d21-4891-8f2e-939edc0124f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd (5d74f098-2416-472f-8cdd-7aa5bdaa74bd): created successfully Sep 25 18:10:23 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e 1073741824 Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39493e89-1d21-4891-8f2e-939edc0124f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (5334dc31-f8fa-463b-ad87-80ad69bde5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:23 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-26d99722-cee8-4a51-99c8-832fe9727f84 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created volume successfully. Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (605501a5-3da0-4e7d-a656-c2d53aa75a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42781281-49fc-4a98-9ac0-eed259cfef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42781281-49fc-4a98-9ac0-eed259cfef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217776425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0889411b-d092-4f5d-9779-483463a3455c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:24Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daddd6e0-2596-4d9b-bc50-0e1d2d7a058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daddd6e0-2596-4d9b-bc50-0e1d2d7a058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d107a1-fc46-4f38-bfb9-ebdb696eeff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d107a1-fc46-4f38-bfb9-ebdb696eeff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0889411b-d092-4f5d-9779-483463a3455c', 'volume_name': 'volume-0889411b-d092-4f5d-9779-483463a3455c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914b853b-c1d7-4c10-b890-e81a09adb8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914b853b-c1d7-4c10-b890-e81a09adb8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4c1128-3ce3-4dd8-bb90-03220d248bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume 0889411b-d092-4f5d-9779-483463a3455c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0889411b-d092-4f5d-9779-483463a3455c', 'volume_size': 1} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:24 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e 1073741824" returned: 0 in 0.619s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:24 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e Sep 25 18:10:24 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (d19950fb-b7d9-4d8b-b7e9-b8f9b14bc119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dba029-0626-466d-869f-3e1fe5b5d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dba029-0626-466d-869f-3e1fe5b5d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-239164819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a99148-ce77-44d8-9376-a40398d19e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:25Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a132f-2d81-45aa-9db7-aa181b39a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a132f-2d81-45aa-9db7-aa181b39a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe700611-cc06-4f35-8174-3152d36ab506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe700611-cc06-4f35-8174-3152d36ab506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a99148-ce77-44d8-9376-a40398d19e35', 'volume_name': 'volume-f8a99148-ce77-44d8-9376-a40398d19e35', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1162f691-2fda-4f64-98f2-9b19e8cf7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1162f691-2fda-4f64-98f2-9b19e8cf7322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2098fa-4384-4ff7-8eb1-98470867f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume f8a99148-ce77-44d8-9376-a40398d19e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a99148-ce77-44d8-9376-a40398d19e35', 'volume_size': 1} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:24 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e" returned: 0 in 0.279s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264395150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd3c90d-239f-4c53-81ca-cd849958d5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:24Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating volume cdd3c90d-239f-4c53-81ca-cd849958d5dc {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:24 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74975999-ca9b-46e1-a310-0b83d9d0830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8433b35f-637f-4bff-99cb-1140d848b89e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323184f0-926a-41f1-a53f-793cf0133f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:24 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc 1073741824 Sep 25 18:10:24 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume volume-8433b35f-637f-4bff-99cb-1140d848b89e (8433b35f-637f-4bff-99cb-1140d848b89e): created successfully Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323184f0-926a-41f1-a53f-793cf0133f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (dcf06306-ba26-4e91-ad09-83b3d6a6c143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f1d55cf6-9e6c-4243-9d78-09fd6953bbca tempest-CreateVolumesFromSnapshotTest-471728151 None] Created volume successfully. Sep 25 18:10:25 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc 1073741824" returned: 0 in 0.487s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:25 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc Sep 25 18:10:25 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:25 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc" returned: 0 in 0.279s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.344s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217776425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0889411b-d092-4f5d-9779-483463a3455c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:24Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating volume 0889411b-d092-4f5d-9779-483463a3455c {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:25 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872ebb0-ca6e-4241-b8b5-7362ad77108f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882a71de-77b7-49c2-aa10-db00e0b2ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:25 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c 1073741824 Sep 25 18:10:25 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc (cdd3c90d-239f-4c53-81ca-cd849958d5dc): created successfully Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882a71de-77b7-49c2-aa10-db00e0b2ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (d657456a-2a92-44d1-af2b-9225e68c8b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-455ced64-d41b-4a8c-a38e-d8ae4ba37345 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created volume successfully. Sep 25 18:10:26 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c 1073741824" returned: 0 in 0.470s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:26 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c Sep 25 18:10:26 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:26 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-239164819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a99148-ce77-44d8-9376-a40398d19e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d73a0658ca4395b931b3167f3e8326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:25Z,use_quota=True,user_id='0df91fbdaa614b24b5673036a80e795e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Creating volume f8a99148-ce77-44d8-9376-a40398d19e35 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:26 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4c1128-3ce3-4dd8-bb90-03220d248bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0889411b-d092-4f5d-9779-483463a3455c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:26 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 1073741824 Sep 25 18:10:26 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d8f704-04d5-499c-b023-c1cc9b9d052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume volume-0889411b-d092-4f5d-9779-483463a3455c (0889411b-d092-4f5d-9779-483463a3455c): created successfully Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d8f704-04d5-499c-b023-c1cc9b9d052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (605501a5-3da0-4e7d-a656-c2d53aa75a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:26 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c918561c-4533-48bd-b3c2-0dfd8aeae280 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created volume successfully. Sep 25 18:10:26 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 1073741824" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:26 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 Sep 25 18:10:26 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:27 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2098fa-4384-4ff7-8eb1-98470867f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a99148-ce77-44d8-9376-a40398d19e35', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0f2714-7da0-4fb7-a301-954d4ebaf5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:27 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Volume volume-f8a99148-ce77-44d8-9376-a40398d19e35 (f8a99148-ce77-44d8-9376-a40398d19e35): created successfully Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0f2714-7da0-4fb7-a301-954d4ebaf5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Flow 'volume_create_manager' (d19950fb-b7d9-4d8b-b7e9-b8f9b14bc119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7af8f0e8-5f9b-4e71-8bd3-33e13d759540 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created volume successfully. Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-f8a99148-ce77-44d8-9376-a40398d19e35-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-f8a99148-ce77-44d8-9376-a40398d19e35-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-f8a99148-ce77-44d8-9376-a40398d19e35" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-f8a99148-ce77-44d8-9376-a40398d19e35" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[464a314c-4507-4abb-896f-aea84e25fce8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:28 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 Sep 25 18:10:28 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:28 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35" returned: 0 in 0.364s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:28 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35 Sep 25 18:10:28 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:28 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f8a99148-ce77-44d8-9376-a40398d19e35" returned: 0 in 0.260s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-f8a99148-ce77-44d8-9376-a40398d19e35" released by "delete_volume" :: held 0.664s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['380e5e72-574e-4251-81b0-77f81719a179', 'a59b1591-b324-4564-b542-f739123d3d4f', 'dcb53bb4-b5a1-45b5-9110-17ad1a41af2c', '68dc380d-1c6e-4fd8-9be0-1c1678af6687'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:28 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:28 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:29 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleted volume successfully. Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-90f94974-e753-4db6-b781-8e07d696fcf0 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-f8a99148-ce77-44d8-9376-a40398d19e35-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-0889411b-d092-4f5d-9779-483463a3455c-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-0889411b-d092-4f5d-9779-483463a3455c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-0889411b-d092-4f5d-9779-483463a3455c" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-0889411b-d092-4f5d-9779-483463a3455c" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00cb302-3254-43ca-94c1-4b0c1d68581e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:29 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c Sep 25 18:10:29 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:29 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c" returned: 0 in 0.354s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:29 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c Sep 25 18:10:29 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:29 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0889411b-d092-4f5d-9779-483463a3455c" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-0889411b-d092-4f5d-9779-483463a3455c" released by "delete_volume" :: held 0.639s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:29 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['2cf163d9-c1b8-48ec-86fe-b1ef2c971096', '54cb4cbd-16ca-4780-9f84-e437f51afb42', '433d5491-7824-4e0e-a138-cf776c57a501', 'd86dba32-35a4-43da-b910-97d54be7d126'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:30 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:30 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:30 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleted volume successfully. Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-70512dd8-cdc1-430e-8d90-e973ba4b27de tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-0889411b-d092-4f5d-9779-483463a3455c-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-cdd3c90d-239f-4c53-81ca-cd849958d5dc-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-cdd3c90d-239f-4c53-81ca-cd849958d5dc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-cdd3c90d-239f-4c53-81ca-cd849958d5dc" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-cdd3c90d-239f-4c53-81ca-cd849958d5dc" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6399b70-bfd9-4cf5-a773-e1dd7b6d96de]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:30 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc Sep 25 18:10:30 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:30 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc" returned: 0 in 0.358s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:30 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc Sep 25 18:10:30 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:31 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-cdd3c90d-239f-4c53-81ca-cd849958d5dc" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-cdd3c90d-239f-4c53-81ca-cd849958d5dc" released by "delete_volume" :: held 0.638s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['f0d1d738-3545-4c24-81b4-c9ef4662ef21', '36c9ff3e-3c90-4fbe-82bd-8726b6015df4', '4905445f-0a3e-4bad-9e05-cbd4e3538196', 'b3387c40-56b7-4b3f-8161-3376f91e84c2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:31 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:31 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:31 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleted volume successfully. Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-614cc10f-5b81-4509-a8c7-2079f91a9ee1 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-cdd3c90d-239f-4c53-81ca-cd849958d5dc-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-8433b35f-637f-4bff-99cb-1140d848b89e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-8433b35f-637f-4bff-99cb-1140d848b89e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-8433b35f-637f-4bff-99cb-1140d848b89e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-8433b35f-637f-4bff-99cb-1140d848b89e" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c6ad38-d767-4500-b5d6-c8a00f16d1ca]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:31 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e Sep 25 18:10:31 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:32 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e" returned: 0 in 0.372s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:32 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e Sep 25 18:10:32 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:32 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8433b35f-637f-4bff-99cb-1140d848b89e" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-8433b35f-637f-4bff-99cb-1140d848b89e" released by "delete_volume" :: held 0.665s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['f48b0f8f-ab82-42cf-9c4d-2d7c30e7cd48', '106bd4c1-08c7-4063-869e-821547780d19', '0b8559ab-08cb-457d-8d55-50f4691ef28a', 'efa4f93f-5ff3-4c54-b894-18b4a296a43b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:32 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:32 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:32 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleted volume successfully. Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-89b6bfa4-9d5e-4d18-a9a3-14b36ba83918 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-8433b35f-637f-4bff-99cb-1140d848b89e-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-5d74f098-2416-472f-8cdd-7aa5bdaa74bd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-5d74f098-2416-472f-8cdd-7aa5bdaa74bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-5d74f098-2416-472f-8cdd-7aa5bdaa74bd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-5d74f098-2416-472f-8cdd-7aa5bdaa74bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a28b17-830e-48ba-99c8-1402f42c0c34]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:32 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd Sep 25 18:10:32 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:33 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd" returned: 0 in 0.361s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:33 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd Sep 25 18:10:33 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:33 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5d74f098-2416-472f-8cdd-7aa5bdaa74bd" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-5d74f098-2416-472f-8cdd-7aa5bdaa74bd" released by "delete_volume" :: held 0.645s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['1b654e8b-4dbf-47c8-a6b4-3c8c1b739da4', '49d4d733-70fa-43ee-a773-ab57beb37a4f', 'e08b594f-8075-4a2b-b57d-cc581c433a4f', '699e0417-baf1-4313-bd7c-b72d74b7e392'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:33 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:33 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:33 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleted volume successfully. Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-74a2c85c-2137-495e-9b02-c2cf0f213c8c tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-5d74f098-2416-472f-8cdd-7aa5bdaa74bd-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-6a51e93f-19f2-492e-ac31-63c92bbddb8f-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-6a51e93f-19f2-492e-ac31-63c92bbddb8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-6a51e93f-19f2-492e-ac31-63c92bbddb8f" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-6a51e93f-19f2-492e-ac31-63c92bbddb8f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleting offline snapshot 6a51e93f-19f2-492e-ac31-63c92bbddb8f of volume 5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] snapshot_file for this snap is: volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8579c1-d2bd-454b-be9b-91b1a26dac19]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:34 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f Sep 25 18:10:34 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:34 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f" returned: 0 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:10:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c3b86d-ef2c-48e4-9fdb-86529b6cf749]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:34 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 Sep 25 18:10:34 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:34 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:34 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f Sep 25 18:10:34 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:35 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f" returned: 0 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:35 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f Sep 25 18:10:35 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:35 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9.6a51e93f-19f2-492e-ac31-63c92bbddb8f" returned: 0 in 0.252s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=145,cinder:SELECT=111,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=109,cinder:UPDATE=157,cinder:INSERT=35,cinder:DELETE=18 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-6a51e93f-19f2-492e-ac31-63c92bbddb8f" released by "_delete_snapshot" :: held 1.405s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" released by "delete_snapshot" :: held 1.428s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['520b728e-9693-4125-9272-0b0f7231e981', '3c887d56-fb19-4b97-8874-506c64aebffa', '55175140-d6b7-48b0-89ea-e552b9f1dc11', '1f73b40a-9158-4457-97f8-7c9f10bbd35f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Delete snapshot completed successfully. Sep 25 18:10:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4e2b60f0-8ee6-4cc9-a41b-079ccd4e7cac tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-6a51e93f-19f2-492e-ac31-63c92bbddb8f-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "cinder-quobyte-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b56c534-7ef2-4af0-9e5f-d914414c2d1a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:36 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 Sep 25 18:10:36 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:36 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" returned: 0 in 0.359s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:36 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9 Sep 25 18:10:36 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:36 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" returned: 0 in 0.273s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-quobyte-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9" released by "delete_volume" :: held 0.711s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Created reservations ['ccef9cb0-5136-4f29-a098-80e51dc2a48d', 'bf5efdd8-6e54-43da-afbc-2cccd2d020d5', 'b16ae303-2585-4b3f-803b-627a12748009', '54ad97fa-0e80-47e0-91bb-a523b5f3fd7f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:36 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:36 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:37 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:37 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Deleted volume successfully. Sep 25 18:10:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-910a2d42-9513-4ebd-b6f5-f24efcd0a4f7 tempest-CreateVolumesFromSnapshotTest-471728151 None] Lock "cinder-5c4f5a9a-de3b-46d6-bc4e-d8c9cf64e0f9-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (d9cb1a2b-1b79-4664-8b07-4f73021a3d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86faf3fe-5640-4618-a3b1-374d3b68eb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86faf3fe-5640-4618-a3b1-374d3b68eb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174767276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350904ab-aae9-4bc5-ad6a-a57a33aca5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:41Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eec05b0-2928-4ec9-806c-e15e35a683be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eec05b0-2928-4ec9-806c-e15e35a683be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd32a297-062d-43d9-89c7-903d0288a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd32a297-062d-43d9-89c7-903d0288a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350904ab-aae9-4bc5-ad6a-a57a33aca5fe', 'volume_name': 'volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef5a4d7-a241-4e94-8242-a0e300928ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef5a4d7-a241-4e94-8242-a0e300928ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac6db3-9195-4f46-9920-a78f93fa7778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:41 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Volume 350904ab-aae9-4bc5-ad6a-a57a33aca5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe', 'volume_size': 1} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174767276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350904ab-aae9-4bc5-ad6a-a57a33aca5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:41Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Creating volume 350904ab-aae9-4bc5-ad6a-a57a33aca5fe {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:41 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:41 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe 1073741824 Sep 25 18:10:41 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7b9ec6e4-8ad0-4589-8bdd-59c8ab953c62 req-a5583d50-9ca3-46bd-a176-b2370080337b tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:41 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe 1073741824" returned: 0 in 0.424s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:41 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe Sep 25 18:10:41 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:41 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe" returned: 0 in 0.242s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7b9ec6e4-8ad0-4589-8bdd-59c8ab953c62 req-a5583d50-9ca3-46bd-a176-b2370080337b tempest-TestStampPattern-1161401935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.464s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [req-7b9ec6e4-8ad0-4589-8bdd-59c8ab953c62 req-a5583d50-9ca3-46bd-a176-b2370080337b tempest-TestStampPattern-1161401935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac6db3-9195-4f46-9920-a78f93fa7778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a3642e-b915-4eb9-8de3-c800b5d44b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:41 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Volume volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe (350904ab-aae9-4bc5-ad6a-a57a33aca5fe): created successfully Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a3642e-b915-4eb9-8de3-c800b5d44b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (d9cb1a2b-1b79-4664-8b07-4f73021a3d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-11eb0b63-5db4-4315-b374-8e14b876a6f0 tempest-ProjectReaderTests-1621378334 None] Created volume successfully. Sep 25 18:10:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-7b9ec6e4-8ad0-4589-8bdd-59c8ab953c62 req-a5583d50-9ca3-46bd-a176-b2370080337b tempest-TestStampPattern-1161401935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951', 'name': 'volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2919c45a-2e7d-4ab0-b52b-1e565ab8b942', 'enforce_multipath': True} {{(pid=86665) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 18:10:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-7b9ec6e4-8ad0-4589-8bdd-59c8ab953c62 req-a5583d50-9ca3-46bd-a176-b2370080337b tempest-TestStampPattern-1161401935 None] attachment_update completed successfully. Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-350904ab-aae9-4bc5-ad6a-a57a33aca5fe-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Lock "cinder-350904ab-aae9-4bc5-ad6a-a57a33aca5fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-quobyte-350904ab-aae9-4bc5-ad6a-a57a33aca5fe" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-350904ab-aae9-4bc5-ad6a-a57a33aca5fe" acquired by "delete_volume" :: waited 0.023s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69effb1-fb96-4f12-8804-3d02b690906b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:42 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe Sep 25 18:10:42 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:42 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe" returned: 0 in 0.426s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:42 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe Sep 25 18:10:42 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:42 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-350904ab-aae9-4bc5-ad6a-a57a33aca5fe" returned: 0 in 0.274s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-350904ab-aae9-4bc5-ad6a-a57a33aca5fe" released by "delete_volume" :: held 0.746s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Created reservations ['f9ee65ff-4e44-446e-be54-e550fae392bb', '0f50c783-caab-4c1f-8a86-9b03f4391ef1', '440e3db0-acd0-467e-a81a-9eb4f6eee0a5', 'b7f586ab-224e-46f1-a293-66f5b5dcbe9f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:43 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:43 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:43 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.257s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Deleted volume successfully. Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0512d173-ca3d-422d-816f-887c88deadfb tempest-ProjectReaderTests-1621378334 None] Lock "cinder-350904ab-aae9-4bc5-ad6a-a57a33aca5fe-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (41565190-70f0-45e8-93a2-51c84404b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8d3b58-adfd-40c0-8a4d-a68cc6432fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8d3b58-adfd-40c0-8a4d-a68cc6432fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37596302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca919706-76b4-4096-a1eb-9a2d76e165b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:44Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2980e7a-be02-4ec1-8c3e-fa96352d4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2980e7a-be02-4ec1-8c3e-fa96352d4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44643c27-6a29-4ae0-9207-6706ced58e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44643c27-6a29-4ae0-9207-6706ced58e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca919706-76b4-4096-a1eb-9a2d76e165b7', 'volume_name': 'volume-ca919706-76b4-4096-a1eb-9a2d76e165b7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6110d21-52b1-4f5a-999f-6b106691905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6110d21-52b1-4f5a-999f-6b106691905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8bd447-efd9-4db7-8263-05976da926bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:43 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Volume ca919706-76b4-4096-a1eb-9a2d76e165b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca919706-76b4-4096-a1eb-9a2d76e165b7', 'volume_size': 1} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37596302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca919706-76b4-4096-a1eb-9a2d76e165b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:44Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Creating volume ca919706-76b4-4096-a1eb-9a2d76e165b7 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:43 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:43 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 1073741824 Sep 25 18:10:43 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:44 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 1073741824" returned: 0 in 0.468s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:44 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 Sep 25 18:10:44 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:44 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7" returned: 0 in 0.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8bd447-efd9-4db7-8263-05976da926bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca919706-76b4-4096-a1eb-9a2d76e165b7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0c06c2-c8ce-4322-91ed-38d1f20ceee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:44 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Volume volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 (ca919706-76b4-4096-a1eb-9a2d76e165b7): created successfully Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0c06c2-c8ce-4322-91ed-38d1f20ceee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (41565190-70f0-45e8-93a2-51c84404b496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:44 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9bb9a2a1-5e9f-452f-b539-e2d32e474cc1 tempest-ProjectReaderTests-1621378334 None] Created volume successfully. Sep 25 18:10:44 devstack cinder-volume[86665]: INFO cinder.volume.manager [req-0eef85b9-a51a-4de7-aeed-a823c9c1f6c5 req-46fbc1ff-a5fd-4aff-a2ea-dcfb53691908 tempest-TestStampPattern-1161401935 None] Terminate volume connection completed successfully. Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [req-0eef85b9-a51a-4de7-aeed-a823c9c1f6c5 req-46fbc1ff-a5fd-4aff-a2ea-dcfb53691908 tempest-TestStampPattern-1161401935 None] Deleting attachment 2919c45a-2e7d-4ab0-b52b-1e565ab8b942. {{(pid=86665) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-ca919706-76b4-4096-a1eb-9a2d76e165b7-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-ca919706-76b4-4096-a1eb-9a2d76e165b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-quobyte-ca919706-76b4-4096-a1eb-9a2d76e165b7" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-ca919706-76b4-4096-a1eb-9a2d76e165b7" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91368fe-dc5b-4e71-8ba9-2ef49ae0e2f1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:45 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 Sep 25 18:10:45 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:45 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7" returned: 0 in 0.378s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:45 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7 Sep 25 18:10:45 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:45 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ca919706-76b4-4096-a1eb-9a2d76e165b7" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-ca919706-76b4-4096-a1eb-9a2d76e165b7" released by "delete_volume" :: held 0.675s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Created reservations ['03704089-7548-4935-bc06-44ff9765f211', 'e57282a9-6d58-44de-909f-22fff8ebcb96', '62ebbb60-ebbc-4f2e-a0d6-bb5301d4f906', 'c3b82aaa-53f5-47b4-8ae1-2e5ce8258877'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:45 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:45 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:46 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.284s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Deleted volume successfully. Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-19146e87-cb37-4c7e-a102-743763432478 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-ca919706-76b4-4096-a1eb-9a2d76e165b7-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (66816118-8edc-4ccd-93b6-8ff83f584e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057bf1d9-7e0e-4c5e-b8cd-03642c9ab180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057bf1d9-7e0e-4c5e-b8cd-03642c9ab180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-569374592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ba8385-d84e-4160-9cf2-49a87ed9695b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:47Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9303e6-2e02-40cd-a336-c72c78dcd5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9303e6-2e02-40cd-a336-c72c78dcd5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dac9eb-4036-40b2-b516-ead3c13b23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dac9eb-4036-40b2-b516-ead3c13b23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ba8385-d84e-4160-9cf2-49a87ed9695b', 'volume_name': 'volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29300bc9-9c83-48dd-a00b-21ed5ed4ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29300bc9-9c83-48dd-a00b-21ed5ed4ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee1758-9d37-4ef3-a6d8-d596d4b35f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:46 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Volume a2ba8385-d84e-4160-9cf2-49a87ed9695b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b', 'volume_size': 1} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-569374592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ba8385-d84e-4160-9cf2-49a87ed9695b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:47Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Creating volume a2ba8385-d84e-4160-9cf2-49a87ed9695b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:46 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:46 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b 1073741824 Sep 25 18:10:46 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:47 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b 1073741824" returned: 0 in 0.607s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:47 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b Sep 25 18:10:47 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:47 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b" returned: 0 in 0.265s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee1758-9d37-4ef3-a6d8-d596d4b35f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82b1be9-d21c-4828-93db-bab87f69d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:47 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Volume volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b (a2ba8385-d84e-4160-9cf2-49a87ed9695b): created successfully Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82b1be9-d21c-4828-93db-bab87f69d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (66816118-8edc-4ccd-93b6-8ff83f584e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d7ff3330-060e-4024-ac55-894cbbd394de tempest-ProjectReaderTests-1621378334 None] Created volume successfully. Sep 25 18:10:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-a2ba8385-d84e-4160-9cf2-49a87ed9695b-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Lock "cinder-a2ba8385-d84e-4160-9cf2-49a87ed9695b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-quobyte-a2ba8385-d84e-4160-9cf2-49a87ed9695b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-a2ba8385-d84e-4160-9cf2-49a87ed9695b" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4651a534-31ba-403a-ace0-375182b86b41]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:49 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b Sep 25 18:10:49 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:49 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b" returned: 0 in 0.367s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:49 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b Sep 25 18:10:49 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Lock "cinder-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-quobyte-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[766e6365-3bc4-47e3-9731-95e0ed76e554]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:49 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a2ba8385-d84e-4160-9cf2-49a87ed9695b" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-a2ba8385-d84e-4160-9cf2-49a87ed9695b" released by "delete_volume" :: held 0.662s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Created reservations ['fe9a329c-90c9-4781-bb1f-79ef2d03c408', '681c52b5-c229-4c2b-8df3-b543e6dbea86', '186c49a3-847c-44da-a47a-152f06bd2806', '0183863e-aa15-4f58-a40a-e067e32b6f35'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:49 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c Sep 25 18:10:49 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:49 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:49 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:49 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:49 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.265s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Deleted volume successfully. Sep 25 18:10:49 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c Sep 25 18:10:49 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5a0bf86a-44ef-4f34-b1fe-e8731544ffed tempest-ProjectReaderTests-1621378334 None] Lock "cinder-a2ba8385-d84e-4160-9cf2-49a87ed9695b-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:50 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c" released by "delete_volume" :: held 0.715s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Created reservations ['0cff6046-a725-4bce-9153-4fe54a5e92d0', '703e918e-4b07-439e-885f-5e6243818434', '5bba7c70-4536-4f79-8d47-1888a1516bf0', '036d0f03-fcf5-40ea-896a-bf63f90dcc0d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:50 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:50 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (717d836b-d86e-426c-9ff7-e6706501872d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03463569-624d-416d-b32c-6bd4684af9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03463569-624d-416d-b32c-6bd4684af9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57065282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce408262-a9f0-4b3c-95f5-75f4f7b9cee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:50Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49185ab7-e325-4da5-922e-d932bcbd1efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49185ab7-e325-4da5-922e-d932bcbd1efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bea8de-476e-4584-a5e9-622195f66351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bea8de-476e-4584-a5e9-622195f66351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce408262-a9f0-4b3c-95f5-75f4f7b9cee7', 'volume_name': 'volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ef5866-5420-4dda-819a-85646f11c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ef5866-5420-4dda-819a-85646f11c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0054e3fa-7f75-4e29-83da-56e9f7e672e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Volume ce408262-a9f0-4b3c-95f5-75f4f7b9cee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7', 'volume_size': 1} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57065282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce408262-a9f0-4b3c-95f5-75f4f7b9cee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8cfe2f31154523a3360f6f1a7d6699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:10:50Z,use_quota=True,user_id='f215404d7713419f9c8c9bc6af7c6906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Creating volume ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:10:50 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:50 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 1073741824 Sep 25 18:10:50 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:50 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.273s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Deleted volume successfully. Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-afa5862e-3447-4bba-9d19-bfd4fa6c5c4a tempest-TestStampPattern-1161401935 None] Lock "cinder-7eef8d3b-a28c-4f6b-9cf6-0aeaaf19160c-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-1dabc29f-1673-44f9-95cb-f8354728fde6-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Lock "cinder-1dabc29f-1673-44f9-95cb-f8354728fde6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-quobyte-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-quobyte-1dabc29f-1673-44f9-95cb-f8354728fde6" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-1dabc29f-1673-44f9-95cb-f8354728fde6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Deleting offline snapshot 1dabc29f-1673-44f9-95cb-f8354728fde6 of volume 48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] snapshot_file for this snap is: volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f7eeee-afc5-49b9-ac88-a8b972634a0a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:51 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 1073741824" returned: 0 in 0.484s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:51 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 Sep 25 18:10:51 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:51 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 Sep 25 18:10:51 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:51 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0054e3fa-7f75-4e29-83da-56e9f7e672e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670a3ff4-52c2-413f-a27c-fa8bcfcb2801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:10:51 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6" returned: 0 in 0.377s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:10:51 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Volume volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 (ce408262-a9f0-4b3c-95f5-75f4f7b9cee7): created successfully Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670a3ff4-52c2-413f-a27c-fa8bcfcb2801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Flow 'volume_create_manager' (717d836b-d86e-426c-9ff7-e6706501872d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf1cf5-8ac6-4230-84f5-30952debec64]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dee0c711-af3c-4411-9c77-93a8e4535f6c tempest-ProjectReaderTests-1621378334 None] Created volume successfully. Sep 25 18:10:51 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f Sep 25 18:10:51 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "cinder-quobyte-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b943bcaf-5a99-49fe-bddd-6c807739c567]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:51 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 Sep 25 18:10:51 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:51 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:51 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 Sep 25 18:10:51 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:51 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:52 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7 Sep 25 18:10:52 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:52 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-quobyte-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7" released by "delete_volume" :: held 0.708s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:52 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6" returned: 0 in 0.369s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:52 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6 Sep 25 18:10:52 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Created reservations ['45487850-7c93-4368-815f-b573bbd8c1b6', '540a8c77-b66b-4709-aa31-b91a35bf62d8', '50d0d872-419c-4966-a908-e0a585f2c927', '6cad2151-536b-4438-b612-aaaf09bd0c22'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:52 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:52 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:52 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f.1dabc29f-1673-44f9-95cb-f8354728fde6" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-1dabc29f-1673-44f9-95cb-f8354728fde6" released by "_delete_snapshot" :: held 1.685s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" released by "delete_snapshot" :: held 1.717s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:52 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Deleted volume successfully. Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Created reservations ['5021b3cd-d54f-483a-89e3-ed85d7552d7c', 'bd1ac40e-38f5-44fe-974a-a688362ded80', '34e49fcc-1d8d-4b32-a560-f404fa6e870b', '29d4e9c8-6624-46eb-acfa-53e278f1deab'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c1baea42-6f43-4d4e-9346-410eb8ee2083 tempest-ProjectReaderTests-1621378334 None] Lock "cinder-ce408262-a9f0-4b3c-95f5-75f4f7b9cee7-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Delete snapshot completed successfully. Sep 25 18:10:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1c1bfb2b-41e4-49b6-89e3-dcf562edc1b5 tempest-TestStampPattern-1161401935 None] Lock "cinder-1dabc29f-1673-44f9-95cb-f8354728fde6-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:55 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:55 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:56 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Lock "cinder-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Acquiring lock "cinder-quobyte-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" acquired by "delete_volume" :: waited 0.012s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d495c8-aad5-4160-9247-c7799a0b530e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:10:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:57 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f Sep 25 18:10:57 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:57 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" returned: 0 in 0.379s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:57 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f Sep 25 18:10:57 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:57 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" returned: 0 in 0.239s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Lock "cinder-quobyte-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f" released by "delete_volume" :: held 0.679s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Created reservations ['af447a39-b249-46ed-bad3-8122561d4390', '93ec7b95-6df8-4a17-9920-391c8ad4d5cc', '78f9b78b-8558-4095-9065-1725485f3092', 'a60cafe7-6d28-4afd-b913-dc5c3a4f53ae'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:10:57 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:10:57 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:10:57 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:10:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Deleted volume successfully. Sep 25 18:10:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f57ad997-cb9a-4ae8-8bd0-18e466491264 tempest-TestStampPattern-1161401935 None] Lock "cinder-48f30bdc-dd7c-46d0-95d7-cb4553ca0a8f-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:07 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=51,cinder:INSERT=23,cinder:UPDATE=83,cinder:DELETE=5 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:11:07 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=70,cinder:INSERT=17,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (09c7c533-0fd6-49e7-9263-c839f6a848b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcd5e94-eb88-429d-a6b5-6271b62f0467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcd5e94-eb88-429d-a6b5-6271b62f0467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405915833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f06e394-2412-40de-8f55-5a1f50b4e54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:09Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9d1094-f97c-4149-8161-e8edfacc364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9d1094-f97c-4149-8161-e8edfacc364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52c5495-8e8f-43a5-a117-19a8bfd72ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52c5495-8e8f-43a5-a117-19a8bfd72ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f06e394-2412-40de-8f55-5a1f50b4e54e', 'volume_name': 'volume-1f06e394-2412-40de-8f55-5a1f50b4e54e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2716cc-91c2-4fd1-987b-80df7cdd847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2716cc-91c2-4fd1-987b-80df7cdd847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25444841-01b6-4ede-97cb-4a925f9a0ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:09 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume 1f06e394-2412-40de-8f55-5a1f50b4e54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f06e394-2412-40de-8f55-5a1f50b4e54e', 'volume_size': 1} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405915833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f06e394-2412-40de-8f55-5a1f50b4e54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:09Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Creating volume 1f06e394-2412-40de-8f55-5a1f50b4e54e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:09 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:09 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e 1073741824 Sep 25 18:11:09 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:09 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e 1073741824" returned: 0 in 0.420s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:09 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e Sep 25 18:11:09 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:09 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25444841-01b6-4ede-97cb-4a925f9a0ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f06e394-2412-40de-8f55-5a1f50b4e54e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002f369c-1b0e-47c1-ab3c-40e824c928d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:09 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume volume-1f06e394-2412-40de-8f55-5a1f50b4e54e (1f06e394-2412-40de-8f55-5a1f50b4e54e): created successfully Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002f369c-1b0e-47c1-ab3c-40e824c928d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (09c7c533-0fd6-49e7-9263-c839f6a848b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4f247d65-e2c0-4c36-b2ad-8550f8ba0898 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created volume successfully. Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (d13c7ae8-61ed-4b2c-8f9f-63334c8d7bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6019c8-dbf8-480f-8b1e-bbf6e08172b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6019c8-dbf8-480f-8b1e-bbf6e08172b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588661877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc925916-aece-4dae-9a1e-77df83507261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:11Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dca7903-413d-4bce-b20f-af4d720f164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dca7903-413d-4bce-b20f-af4d720f164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5188e324-9f7c-41ab-8b6b-e25484051ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5188e324-9f7c-41ab-8b6b-e25484051ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc925916-aece-4dae-9a1e-77df83507261', 'volume_name': 'volume-dc925916-aece-4dae-9a1e-77df83507261', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3523ca-860c-44c3-8166-bcf08b88a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3523ca-860c-44c3-8166-bcf08b88a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a152325-795a-42ea-ad2b-5d21a297421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume dc925916-aece-4dae-9a1e-77df83507261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc925916-aece-4dae-9a1e-77df83507261', 'volume_size': 1} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588661877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc925916-aece-4dae-9a1e-77df83507261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:11Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Creating volume dc925916-aece-4dae-9a1e-77df83507261 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:10 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:10 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 1073741824 Sep 25 18:11:10 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (730d8db6-ef3b-4777-878f-c8f9a65ae19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa121ba2-335e-4661-8568-a2415d982ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa121ba2-335e-4661-8568-a2415d982ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564758719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c91800d-020c-495a-ad71-a9a3e074d8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:11Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7f1db7-a3a1-4774-9a30-aab1e43ac3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7f1db7-a3a1-4774-9a30-aab1e43ac3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a484d-7abe-4562-b1b8-67e511115594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a484d-7abe-4562-b1b8-67e511115594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c91800d-020c-495a-ad71-a9a3e074d8ae', 'volume_name': 'volume-4c91800d-020c-495a-ad71-a9a3e074d8ae', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dc8bd3-57b1-4986-a239-8613ffcdf3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dc8bd3-57b1-4986-a239-8613ffcdf3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b913fe-eb21-41d5-bb2a-3a039b89a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume 4c91800d-020c-495a-ad71-a9a3e074d8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c91800d-020c-495a-ad71-a9a3e074d8ae', 'volume_size': 1} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:11 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 1073741824" returned: 0 in 0.489s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:11 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 Sep 25 18:11:11 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (38a7afdd-1d35-4350-820f-6fd1bdbad1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41842d0-bdf6-4a7e-99f6-b8678c95c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41842d0-bdf6-4a7e-99f6-b8678c95c38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039565916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9bf45-f62c-4a8e-8b09-a3525ec1530d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:11Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af586b83-7e01-4496-a8db-141bca6a160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af586b83-7e01-4496-a8db-141bca6a160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab17394c-6bbe-4300-bd9d-840bc7ea59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab17394c-6bbe-4300-bd9d-840bc7ea59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f9bf45-f62c-4a8e-8b09-a3525ec1530d', 'volume_name': 'volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0cf33c-4650-4c34-b875-a266e76568f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0cf33c-4650-4c34-b875-a266e76568f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658b7481-0f19-4231-a3f0-92e52cd7f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume a5f9bf45-f62c-4a8e-8b09-a3525ec1530d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d', 'volume_size': 1} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:11 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261" returned: 0 in 0.274s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564758719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c91800d-020c-495a-ad71-a9a3e074d8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:11Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Creating volume 4c91800d-020c-495a-ad71-a9a3e074d8ae {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:11 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a152325-795a-42ea-ad2b-5d21a297421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc925916-aece-4dae-9a1e-77df83507261', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45797a90-069e-4906-87d4-4dbe18d501ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae 1073741824 Sep 25 18:11:11 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:11 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume volume-dc925916-aece-4dae-9a1e-77df83507261 (dc925916-aece-4dae-9a1e-77df83507261): created successfully Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45797a90-069e-4906-87d4-4dbe18d501ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (d13c7ae8-61ed-4b2c-8f9f-63334c8d7bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:11 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-aceb9b20-793d-42e0-83f8-48887e3681df tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created volume successfully. Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (e2418d4f-1dab-4c02-9fbd-21c11ed36ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370aae6e-4048-4f29-9858-57297f967b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370aae6e-4048-4f29-9858-57297f967b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305370830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebb0711-5b6a-4b0f-8f53-b8637b056d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:12Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6de92b4-fcea-4c28-90d4-29108bc1f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6de92b4-fcea-4c28-90d4-29108bc1f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44ce12c-6e05-4e9f-9e03-98c28635d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44ce12c-6e05-4e9f-9e03-98c28635d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebb0711-5b6a-4b0f-8f53-b8637b056d92', 'volume_name': 'volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae234440-24a3-41af-8478-6dfe1d9d43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae234440-24a3-41af-8478-6dfe1d9d43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a094a25-bd11-40ca-b877-0a4f373a1614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:11 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume 7ebb0711-5b6a-4b0f-8f53-b8637b056d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92', 'volume_size': 1} Sep 25 18:11:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:11 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae 1073741824" returned: 0 in 0.522s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:12 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae Sep 25 18:11:12 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (f377a65d-4bef-4aa3-babe-7eaa6a9aa353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9af29c8-4608-4dec-9309-ec6bf4cec2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9af29c8-4608-4dec-9309-ec6bf4cec2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-832722403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5598e7a-702c-4460-ba67-7f1f745e2023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:12Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1aa2a9-568a-4cb9-970f-cfb0ba3b1197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1aa2a9-568a-4cb9-970f-cfb0ba3b1197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830aaf00-3512-42c8-9e19-ba05fbb2cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830aaf00-3512-42c8-9e19-ba05fbb2cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5598e7a-702c-4460-ba67-7f1f745e2023', 'volume_name': 'volume-f5598e7a-702c-4460-ba67-7f1f745e2023', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802fb51f-50c9-4bba-9e23-e67960db4218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802fb51f-50c9-4bba-9e23-e67960db4218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034def2-8c0f-4eed-9f11-4acd56805ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume f5598e7a-702c-4460-ba67-7f1f745e2023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5598e7a-702c-4460-ba67-7f1f745e2023', 'volume_size': 1} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:12 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039565916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9bf45-f62c-4a8e-8b09-a3525ec1530d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:11Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Creating volume a5f9bf45-f62c-4a8e-8b09-a3525ec1530d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:12 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b913fe-eb21-41d5-bb2a-3a039b89a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c91800d-020c-495a-ad71-a9a3e074d8ae', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0e3cf5-4c0c-430a-a925-c9cf59eab127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:12 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d 1073741824 Sep 25 18:11:12 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume volume-4c91800d-020c-495a-ad71-a9a3e074d8ae (4c91800d-020c-495a-ad71-a9a3e074d8ae): created successfully Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0e3cf5-4c0c-430a-a925-c9cf59eab127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (730d8db6-ef3b-4777-878f-c8f9a65ae19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6ffc2a9e-26d7-4cab-b0b5-455446da06d4 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created volume successfully. Sep 25 18:11:12 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d 1073741824" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:12 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d Sep 25 18:11:12 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:13 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305370830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebb0711-5b6a-4b0f-8f53-b8637b056d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:12Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Creating volume 7ebb0711-5b6a-4b0f-8f53-b8637b056d92 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:13 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658b7481-0f19-4231-a3f0-92e52cd7f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:13 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 1073741824 Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb892f9b-6bf0-4e5e-ae57-2c5bd8293fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:13 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d (a5f9bf45-f62c-4a8e-8b09-a3525ec1530d): created successfully Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb892f9b-6bf0-4e5e-ae57-2c5bd8293fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (38a7afdd-1d35-4350-820f-6fd1bdbad1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f986927e-c3db-40c6-bd7c-3af40fc81564 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created volume successfully. Sep 25 18:11:13 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 1073741824" returned: 0 in 0.430s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:13 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 Sep 25 18:11:13 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:13 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92" returned: 0 in 0.252s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-832722403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5598e7a-702c-4460-ba67-7f1f745e2023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93be8bd700554909a2a108991bb72fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:12Z,use_quota=True,user_id='4c17f5a2b3ac4a7f915e7803e19605bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Creating volume f5598e7a-702c-4460-ba67-7f1f745e2023 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:13 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:13 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 1073741824 Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a094a25-bd11-40ca-b877-0a4f373a1614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:13 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609b776d-7834-4dc8-a663-fe19b9595149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:13 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 (7ebb0711-5b6a-4b0f-8f53-b8637b056d92): created successfully Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609b776d-7834-4dc8-a663-fe19b9595149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:13 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (e2418d4f-1dab-4c02-9fbd-21c11ed36ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-20a6c951-9a6b-4318-bf64-35bff9f09729 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created volume successfully. Sep 25 18:11:14 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 1073741824" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:14 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 Sep 25 18:11:14 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:14 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023" returned: 0 in 0.236s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034def2-8c0f-4eed-9f11-4acd56805ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5598e7a-702c-4460-ba67-7f1f745e2023', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4613c085-406d-45e9-8785-acbba9f11f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:14 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Volume volume-f5598e7a-702c-4460-ba67-7f1f745e2023 (f5598e7a-702c-4460-ba67-7f1f745e2023): created successfully Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4613c085-406d-45e9-8785-acbba9f11f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Flow 'volume_create_manager' (f377a65d-4bef-4aa3-babe-7eaa6a9aa353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2e33d676-c860-43fb-b5ef-8898ae75ba59 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created volume successfully. Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-f5598e7a-702c-4460-ba67-7f1f745e2023-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-f5598e7a-702c-4460-ba67-7f1f745e2023-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-quobyte-f5598e7a-702c-4460-ba67-7f1f745e2023" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-f5598e7a-702c-4460-ba67-7f1f745e2023" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefb5b2-6bcf-4d55-bbaf-9ad3eed09794]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:15 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 Sep 25 18:11:15 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:15 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023" returned: 0 in 0.360s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:15 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023 Sep 25 18:11:15 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:16 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f5598e7a-702c-4460-ba67-7f1f745e2023" returned: 0 in 0.252s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-f5598e7a-702c-4460-ba67-7f1f745e2023" released by "delete_volume" :: held 0.652s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created reservations ['2ba150db-2bd2-4217-ad46-e2d5c6438ee4', '47235b24-e509-4d40-bd09-e5b0ad3b2a5b', '25fa24e2-a58e-4cc2-94cf-2109df8b4f8a', 'd1ce163c-65ec-491f-87e1-38cdfd0fd128'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:16 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:16 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:16 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Deleted volume successfully. Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-14fa52dc-ac0d-4ce0-a0be-1385afca1516 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-f5598e7a-702c-4460-ba67-7f1f745e2023-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-7ebb0711-5b6a-4b0f-8f53-b8637b056d92-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-7ebb0711-5b6a-4b0f-8f53-b8637b056d92-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-quobyte-7ebb0711-5b6a-4b0f-8f53-b8637b056d92" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-7ebb0711-5b6a-4b0f-8f53-b8637b056d92" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[055a4498-3f12-42e3-9d9c-05109d6be094]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:16 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 Sep 25 18:11:16 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:17 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92" returned: 0 in 0.353s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:17 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92 Sep 25 18:11:17 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:17 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7ebb0711-5b6a-4b0f-8f53-b8637b056d92" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-7ebb0711-5b6a-4b0f-8f53-b8637b056d92" released by "delete_volume" :: held 0.648s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created reservations ['480ef1b9-d01e-4371-a0bb-0e24787a256e', '49087e66-d860-40e5-81fa-365d82035326', '93befcee-f488-4b19-bee7-24ade9102cad', '6b2e359e-b066-4435-85c1-face33cce3c0'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:17 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:17 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:17 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Deleted volume successfully. Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d56cf78d-a0a4-485b-9222-ed458c8f6fdb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-7ebb0711-5b6a-4b0f-8f53-b8637b056d92-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-quobyte-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[607a6e5b-4076-45e7-9584-f4931c4840f9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:17 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d Sep 25 18:11:17 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:18 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d" returned: 0 in 0.365s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:18 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d Sep 25 18:11:18 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:18 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d" released by "delete_volume" :: held 0.653s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created reservations ['b9f86b08-f76a-41da-8d1f-8fdcfec0cf81', 'ad4b1b56-c0e4-4c3f-bae5-e95a23f8d736', '28ed4ab8-961c-4051-8d47-5f13e12f8111', '31540c27-9bf9-489b-ab83-3245bdc2bf86'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:18 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:18 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:18 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.239s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Deleted volume successfully. Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d8a23ce8-6be7-443b-b874-cdf638d5e015 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-a5f9bf45-f62c-4a8e-8b09-a3525ec1530d-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-4c91800d-020c-495a-ad71-a9a3e074d8ae-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-4c91800d-020c-495a-ad71-a9a3e074d8ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-quobyte-4c91800d-020c-495a-ad71-a9a3e074d8ae" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-4c91800d-020c-495a-ad71-a9a3e074d8ae" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5f939-460d-4a80-8c47-1d8c02304c84]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:19 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae Sep 25 18:11:19 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:19 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae" returned: 0 in 0.361s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:19 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae Sep 25 18:11:19 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:19 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4c91800d-020c-495a-ad71-a9a3e074d8ae" returned: 0 in 0.242s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-4c91800d-020c-495a-ad71-a9a3e074d8ae" released by "delete_volume" :: held 0.640s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created reservations ['ac6d6654-f8fe-4cfa-b2a6-1e33e50dae1e', 'df92537f-0e2b-4fe6-a912-1fe75a71add1', 'e7bbd8fd-d1e7-40ba-9293-d3cf53adf410', 'b3fd56fc-9b51-4a53-9340-787e974ddec4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:19 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:19 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:20 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.243s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Deleted volume successfully. Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-56c547ca-9e65-4970-a3e8-626cf60b2e42 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-4c91800d-020c-495a-ad71-a9a3e074d8ae-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-dc925916-aece-4dae-9a1e-77df83507261-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-dc925916-aece-4dae-9a1e-77df83507261-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-quobyte-dc925916-aece-4dae-9a1e-77df83507261" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-dc925916-aece-4dae-9a1e-77df83507261" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03d8bb-9e8f-4333-9351-d476873d40cc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:20 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 Sep 25 18:11:20 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:20 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261" returned: 0 in 0.357s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:20 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261 Sep 25 18:11:20 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:20 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-dc925916-aece-4dae-9a1e-77df83507261" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-dc925916-aece-4dae-9a1e-77df83507261" released by "delete_volume" :: held 0.647s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created reservations ['5a890e01-c76f-4013-9f98-c102d1eed378', '014b86ea-f4ed-4a98-ac2b-c95ade272269', '80031965-b85f-40b7-b755-505a82b11b9e', 'b9a0365e-cd2d-43fe-9e08-303499fce900'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:20 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:20 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:21 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Deleted volume successfully. Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c87bb21d-1845-4cf9-ae46-4b0832749ea9 tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-dc925916-aece-4dae-9a1e-77df83507261-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-1f06e394-2412-40de-8f55-5a1f50b4e54e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-1f06e394-2412-40de-8f55-5a1f50b4e54e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "cinder-quobyte-1f06e394-2412-40de-8f55-5a1f50b4e54e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-1f06e394-2412-40de-8f55-5a1f50b4e54e" acquired by "delete_volume" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef9be7-7b39-42ec-843c-6a4f1622d2bf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:21 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e Sep 25 18:11:21 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:21 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e" returned: 0 in 0.345s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:21 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e Sep 25 18:11:21 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:21 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f06e394-2412-40de-8f55-5a1f50b4e54e" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-quobyte-1f06e394-2412-40de-8f55-5a1f50b4e54e" released by "delete_volume" :: held 0.630s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Created reservations ['91514337-8ac5-48e9-80ad-abb3083d3807', '1495177e-0850-4534-ad84-a44b31372647', 'f5740832-8521-4ec4-ab6a-fa1e47d963c0', 'b4151f08-5aca-4b7d-a3ba-898c1ac273a2'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:22 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:22 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:22 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Deleted volume successfully. Sep 25 18:11:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8cb02212-9842-4634-9ceb-18615aed92bb tempest-CreateVolumesFromSourceVolumeTest-1108902315 None] Lock "cinder-1f06e394-2412-40de-8f55-5a1f50b4e54e-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Flow 'volume_create_manager' (324a4150-1555-441c-a711-2c59fae09090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0755f8-2406-446e-bd8a-631b0678abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0755f8-2406-446e-bd8a-631b0678abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-757079864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33a70a8-4567-484f-823f-e6d37b98c54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3e0cc690a34bc0b171952fac5e627b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:25Z,use_quota=True,user_id='1dcb026a4c134a5aaf0ddffe4b4632e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae4e372-ffec-4ce9-9bce-7fb5e9dea16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae4e372-ffec-4ce9-9bce-7fb5e9dea16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9dcdf-9955-4b18-9d07-470e9a9fd4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9dcdf-9955-4b18-9d07-470e9a9fd4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33a70a8-4567-484f-823f-e6d37b98c54a', 'volume_name': 'volume-e33a70a8-4567-484f-823f-e6d37b98c54a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39296996-d726-4348-8e85-a42d3cf125d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39296996-d726-4348-8e85-a42d3cf125d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c9dd8d-d8f9-4bb8-addf-87fb40649559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Volume e33a70a8-4567-484f-823f-e6d37b98c54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33a70a8-4567-484f-823f-e6d37b98c54a', 'volume_size': 1} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-757079864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33a70a8-4567-484f-823f-e6d37b98c54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3e0cc690a34bc0b171952fac5e627b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:25Z,use_quota=True,user_id='1dcb026a4c134a5aaf0ddffe4b4632e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Creating volume e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:25 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:25 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a 1073741824 Sep 25 18:11:25 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:25 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a 1073741824" returned: 0 in 0.425s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:25 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a Sep 25 18:11:25 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:25 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a" returned: 0 in 0.239s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c9dd8d-d8f9-4bb8-addf-87fb40649559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33a70a8-4567-484f-823f-e6d37b98c54a', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0cf3cd-3417-47aa-a2d5-08633a7d0af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Volume volume-e33a70a8-4567-484f-823f-e6d37b98c54a (e33a70a8-4567-484f-823f-e6d37b98c54a): created successfully Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0cf3cd-3417-47aa-a2d5-08633a7d0af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Flow 'volume_create_manager' (324a4150-1555-441c-a711-2c59fae09090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-25a57126-d338-40e7-bdbc-6b9391c019af tempest-VolumeDependencyTests-1525929519 None] Created volume successfully. Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Creating offline snapshot 0c80e9ef-0e4c-4557-99f5-155296d332e0 of volume e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6eef4-770c-42fb-9f7f-6e12b60a85fd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:26 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a Sep 25 18:11:26 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:26 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:26 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 1G Sep 25 18:11:26 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:26 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 1G" returned: 0 in 0.393s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33a70a8-4567-484f-823f-e6d37b98c54a -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:26 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33a70a8-4567-484f-823f-e6d37b98c54a -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 Sep 25 18:11:26 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:27 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33a70a8-4567-484f-823f-e6d37b98c54a -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:27 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 is being set with open permissions: ugo+rw Sep 25 18:11:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:27 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 Sep 25 18:11:27 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:27 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:27 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info Sep 25 18:11:27 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:27 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:27 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info is being set with open permissions: ugo+rw Sep 25 18:11:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:27 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info Sep 25 18:11:27 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:28 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.info" returned: 0 in 0.240s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9f769cb1-f3aa-4a62-9ae0-a4c597c6740a tempest-VolumeDependencyTests-1525929519 None] Create snapshot completed successfully Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Flow 'volume_create_manager' (1931fa27-2b82-423b-b04b-14ffa0685207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975b9cd6-ae6d-4437-b982-4903149f6d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975b9cd6-ae6d-4437-b982-4903149f6d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2110608564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2668b2-0459-4078-b71c-9ab6540ee41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3e0cc690a34bc0b171952fac5e627b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c80e9ef-0e4c-4557-99f5-155296d332e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:29Z,use_quota=True,user_id='1dcb026a4c134a5aaf0ddffe4b4632e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69c1fa6-1077-4f59-8752-39e1db4e48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69c1fa6-1077-4f59-8752-39e1db4e48d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ee7957-3fb5-43f8-871f-9c57370209d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ee7957-3fb5-43f8-871f-9c57370209d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c2668b2-0459-4078-b71c-9ab6540ee41d', 'volume_name': 'volume-5c2668b2-0459-4078-b71c-9ab6540ee41d', 'volume_size': 1, 'snapshot_id': '0c80e9ef-0e4c-4557-99f5-155296d332e0'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb3feb2-eff7-4bd9-b20c-858f1c351e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb3feb2-eff7-4bd9-b20c-858f1c351e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74687019-0b54-415a-8762-bf9d72e7499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Volume 5c2668b2-0459-4078-b71c-9ab6540ee41d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c2668b2-0459-4078-b71c-9ab6540ee41d', 'volume_size': 1, 'snapshot_id': '0c80e9ef-0e4c-4557-99f5-155296d332e0'} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-quobyte-0c80e9ef-0e4c-4557-99f5-155296d332e0-5c2668b2-0459-4078-b71c-9ab6540ee41d" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-0c80e9ef-0e4c-4557-99f5-155296d332e0-5c2668b2-0459-4078-b71c-9ab6540ee41d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Creating volume 5c2668b2-0459-4078-b71c-9ab6540ee41d from snapshot 0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-quobyte-5c2668b2-0459-4078-b71c-9ab6540ee41d" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-5c2668b2-0459-4078-b71c-9ab6540ee41d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] snapshot: 0c80e9ef-0e4c-4557-99f5-155296d332e0, volume: 5c2668b2-0459-4078-b71c-9ab6540ee41d, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1297d402-73cc-41e3-b0d9-60b91d349962]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:29 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 Sep 25 18:11:29 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:29 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0" returned: 0 in 0.369s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e33a70a8-4567-484f-823f-e6d37b98c54a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7542cb-f800-4efb-a4df-59c78540ae31]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:29 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a Sep 25 18:11:29 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:29 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a" returned: 0 in 0.351s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:11:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:29 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d Sep 25 18:11:29 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:35 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d" returned: 0 in 6.002s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:11:35 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Converted 1024.00 MB image at 170.59 MB/s Sep 25 18:11:35 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d is being set with open permissions: ugo+rw Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:35 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d Sep 25 18:11:35 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:35 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d" returned: 0 in 0.261s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-5c2668b2-0459-4078-b71c-9ab6540ee41d" released by "_copy_volume_from_snapshot" :: held 7.067s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-0c80e9ef-0e4c-4557-99f5-155296d332e0-5c2668b2-0459-4078-b71c-9ab6540ee41d" released by "_create_volume_from_snapshot" :: held 7.127s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.141s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74687019-0b54-415a-8762-bf9d72e7499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2668b2-0459-4078-b71c-9ab6540ee41d', 'volume_size': 1, 'snapshot_id': '0c80e9ef-0e4c-4557-99f5-155296d332e0'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709a8a4c-3bc2-4927-b74c-f8e91e77f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:36 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Volume volume-5c2668b2-0459-4078-b71c-9ab6540ee41d (5c2668b2-0459-4078-b71c-9ab6540ee41d): created successfully Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709a8a4c-3bc2-4927-b74c-f8e91e77f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Flow 'volume_create_manager' (1931fa27-2b82-423b-b04b-14ffa0685207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-142b441e-1f4b-45f5-9022-24fc0b0c20b8 tempest-VolumeDependencyTests-1525929519 None] Created volume successfully. Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-0c80e9ef-0e4c-4557-99f5-155296d332e0-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-0c80e9ef-0e4c-4557-99f5-155296d332e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-quobyte-e33a70a8-4567-484f-823f-e6d37b98c54a" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-e33a70a8-4567-484f-823f-e6d37b98c54a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-quobyte-0c80e9ef-0e4c-4557-99f5-155296d332e0" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-0c80e9ef-0e4c-4557-99f5-155296d332e0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Deleting offline snapshot 0c80e9ef-0e4c-4557-99f5-155296d332e0 of volume e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] snapshot_file for this snap is: volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998a4e4-29a8-449a-8cb7-091c4d8134a8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:36 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 Sep 25 18:11:36 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:36 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0" returned: 0 in 0.346s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e33a70a8-4567-484f-823f-e6d37b98c54a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[0397057e-4223-4487-ae7b-71ea378aa48b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:36 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a Sep 25 18:11:36 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:37 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a" returned: 0 in 0.531s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:37 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 Sep 25 18:11:37 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:37 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0" returned: 0 in 0.318s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:37 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0 Sep 25 18:11:37 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:37 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a.0c80e9ef-0e4c-4557-99f5-155296d332e0" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-0c80e9ef-0e4c-4557-99f5-155296d332e0" released by "_delete_snapshot" :: held 1.540s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-e33a70a8-4567-484f-823f-e6d37b98c54a" released by "delete_snapshot" :: held 1.564s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Created reservations ['cf5c7d53-ac0f-4e7e-8753-b1080418a550', '8da44b9b-ca03-417b-b586-58a27603e376', 'c5e1b8fd-8855-497f-972b-f16e4e72dabe', '3068c950-370c-4bbe-a4a7-fa6093db8b59'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Delete snapshot completed successfully. Sep 25 18:11:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f24932e4-6b56-49f4-b2c1-62789e397ac7 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-0c80e9ef-0e4c-4557-99f5-155296d332e0-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-e33a70a8-4567-484f-823f-e6d37b98c54a-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-e33a70a8-4567-484f-823f-e6d37b98c54a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-quobyte-e33a70a8-4567-484f-823f-e6d37b98c54a" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-e33a70a8-4567-484f-823f-e6d37b98c54a" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a494bd77-be60-43a5-8754-0b41e55af618]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:38 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a Sep 25 18:11:38 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:38 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a" returned: 0 in 0.375s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:38 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a Sep 25 18:11:38 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:39 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e33a70a8-4567-484f-823f-e6d37b98c54a" returned: 0 in 0.257s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-e33a70a8-4567-484f-823f-e6d37b98c54a" released by "delete_volume" :: held 0.689s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Created reservations ['f139bd20-1bbd-4c62-80ba-efd83b0974c8', '687f4393-7d40-48b1-85f7-1b477a9bedff', '8d35ddea-f7eb-4906-829a-f6009600bdaf', 'cdd5ec37-e3f5-4c0c-8e29-9172e8f8d761'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:39 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:39 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:39 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.261s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:39 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Deleted volume successfully. Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-5c2668b2-0459-4078-b71c-9ab6540ee41d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8756c04f-8a8c-4832-baf6-ca066dc2e033 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-e33a70a8-4567-484f-823f-e6d37b98c54a-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-5c2668b2-0459-4078-b71c-9ab6540ee41d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "cinder-quobyte-5c2668b2-0459-4078-b71c-9ab6540ee41d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-5c2668b2-0459-4078-b71c-9ab6540ee41d" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd18de-6a11-42c7-a785-81f89e2fcc95]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:39 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d Sep 25 18:11:39 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:40 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d" returned: 0 in 0.365s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:40 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d Sep 25 18:11:40 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:40 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5c2668b2-0459-4078-b71c-9ab6540ee41d" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-quobyte-5c2668b2-0459-4078-b71c-9ab6540ee41d" released by "delete_volume" :: held 0.654s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Created reservations ['e4f7214f-0565-4e90-a0b0-2bb0d28d855e', 'd9f683f3-001b-4c1f-90e1-d383c0c1fa8d', '713060ae-e086-438c-87c2-e1fe2334ea39', 'cf73d4de-c2ad-4f74-9487-4ec8ed4d05ac'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:40 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:40 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:40 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.239s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Deleted volume successfully. Sep 25 18:11:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a521158e-82cc-4eb3-b489-be04f59d6868 tempest-VolumeDependencyTests-1525929519 None] Lock "cinder-5c2668b2-0459-4078-b71c-9ab6540ee41d-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Flow 'volume_create_manager' (3af5fa29-119a-46c9-8ab9-ace72392174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae4a0d-695b-4acb-ba06-e48b20d5e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae4a0d-695b-4acb-ba06-e48b20d5e562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b282eb-e996-44e0-903b-d768213e2a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e6e42f35c647028a255dccfbe41fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:45Z,use_quota=True,user_id='9649e405f0d44ca7856696b91dee01de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0646e4f9-248b-403e-8b1e-1601c0d7a335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0646e4f9-248b-403e-8b1e-1601c0d7a335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760ad004-b1cc-4962-ba83-6bb536dcb79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760ad004-b1cc-4962-ba83-6bb536dcb79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32b282eb-e996-44e0-903b-d768213e2a54', 'volume_name': 'volume-32b282eb-e996-44e0-903b-d768213e2a54', 'volume_size': 1, 'image_id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86532d7d-7690-4bd4-b924-ae24dd5627ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '520df31985c6338da96e9f917cde06e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44e6e42f35c647028a255dccfbe41fae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1a85e4abf81f4a909cb2f59fadcdb437c2969aca3a411eb6f0c7cac74c23836d4a9f27835a3a1f01f54e4ce9d14aba605eddf510dda35af84ddb947f9b5c774', 'id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'created_at': datetime.datetime(2026, 9, 25, 16, 11, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 11, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86532d7d-7690-4bd4-b924-ae24dd5627ec/file', 'properties': {}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adb04a3-3acf-41af-965c-67e9194f4755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4adb04a3-3acf-41af-965c-67e9194f4755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5772e66-c686-4e1d-a92d-059fbeca9f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:45 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Volume 32b282eb-e996-44e0-903b-d768213e2a54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32b282eb-e996-44e0-903b-d768213e2a54', 'volume_size': 1, 'image_id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86532d7d-7690-4bd4-b924-ae24dd5627ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '520df31985c6338da96e9f917cde06e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44e6e42f35c647028a255dccfbe41fae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1a85e4abf81f4a909cb2f59fadcdb437c2969aca3a411eb6f0c7cac74c23836d4a9f27835a3a1f01f54e4ce9d14aba605eddf510dda35af84ddb947f9b5c774', 'id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'created_at': datetime.datetime(2026, 9, 25, 16, 11, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 11, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86532d7d-7690-4bd4-b924-ae24dd5627ec/file', 'properties': {}}, 'image_service': } Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Trying to clone 32b282eb-e996-44e0-903b-d768213e2a54 from image 86532d7d-7690-4bd4-b924-ae24dd5627ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/86532d7d-7690-4bd4-b924-ae24dd5627ec', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:11:45 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Image download 0.00 MB at 0.00 MB/s Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[da632019-0141-44bd-8c8f-32c113acf12b]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:46 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD Sep 25 18:11:46 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:46 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:46 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD Sep 25 18:11:46 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:46 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Temporary image 86532d7d-7690-4bd4-b924-ae24dd5627ec is fetched for user 9649e405f0d44ca7856696b91dee01de. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e804a9b-36fe-4d5b-982d-f1e44e12567f]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:46 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD Sep 25 18:11:46 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:46 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:47 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD Sep 25 18:11:47 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:47 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD" returned: 1 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b282eb-e996-44e0-903b-d768213e2a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e6e42f35c647028a255dccfbe41fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:45Z,use_quota=True,user_id='9649e405f0d44ca7856696b91dee01de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Creating volume 32b282eb-e996-44e0-903b-d768213e2a54 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:47 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:47 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 1073741824 Sep 25 18:11:47 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:47 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 1073741824" returned: 0 in 0.403s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:47 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 Sep 25 18:11:47 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:47 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:47 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Attempting download of 86532d7d-7690-4bd4-b924-ae24dd5627ec ((None, [{'url': 'file:///opt/stack/data/glance/images/86532d7d-7690-4bd4-b924-ae24dd5627ec', 'metadata': {}}])) to volume 32b282eb-e996-44e0-903b-d768213e2a54. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[128290a9-6ff4-49d2-b2ca-8438b2723fb7]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:48 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp Sep 25 18:11:48 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:48 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp" returned: 0 in 0.324s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:48 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp Sep 25 18:11:48 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:48 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp" returned: 1 in 0.315s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86532d7d-7690-4bd4-b924-ae24dd5627ec_f_05cmsp' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35cce7d-ef64-4b41-ad27-b723f6a54a2e]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:48 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD Sep 25 18:11:48 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:49 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:49 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD Sep 25 18:11:49 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:49 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] 86532d7d-7690-4bd4-b924-ae24dd5627ec was raw, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:49 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 Sep 25 18:11:49 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:49 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54" returned: 0 in 0.433s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86532d7d-7690-4bd4-b924-ae24dd5627ec_cppcthj6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:11:49 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 18:11:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:49 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 1G Sep 25 18:11:49 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:50 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 1G" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Downloaded image 86532d7d-7690-4bd4-b924-ae24dd5627ec ((None, [{'url': 'file:///opt/stack/data/glance/images/86532d7d-7690-4bd4-b924-ae24dd5627ec', 'metadata': {}}])) to volume 32b282eb-e996-44e0-903b-d768213e2a54 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Temporary image 86532d7d-7690-4bd4-b924-ae24dd5627ec for user 9649e405f0d44ca7856696b91dee01de is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Marking volume 32b282eb-e996-44e0-903b-d768213e2a54 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Copying metadata from image 86532d7d-7690-4bd4-b924-ae24dd5627ec to 32b282eb-e996-44e0-903b-d768213e2a54. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Creating volume glance metadata for volume 32b282eb-e996-44e0-903b-d768213e2a54 backed by image 86532d7d-7690-4bd4-b924-ae24dd5627ec with: {'image_id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '520df31985c6338da96e9f917cde06e3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5772e66-c686-4e1d-a92d-059fbeca9f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b282eb-e996-44e0-903b-d768213e2a54', 'volume_size': 1, 'image_id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86532d7d-7690-4bd4-b924-ae24dd5627ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '520df31985c6338da96e9f917cde06e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44e6e42f35c647028a255dccfbe41fae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1a85e4abf81f4a909cb2f59fadcdb437c2969aca3a411eb6f0c7cac74c23836d4a9f27835a3a1f01f54e4ce9d14aba605eddf510dda35af84ddb947f9b5c774', 'id': '86532d7d-7690-4bd4-b924-ae24dd5627ec', 'created_at': datetime.datetime(2026, 9, 25, 16, 11, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 11, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86532d7d-7690-4bd4-b924-ae24dd5627ec/file', 'properties': {}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3215d3f4-c94b-40e6-a323-a28519e2f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Volume volume-32b282eb-e996-44e0-903b-d768213e2a54 (32b282eb-e996-44e0-903b-d768213e2a54): created successfully Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3215d3f4-c94b-40e6-a323-a28519e2f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Flow 'volume_create_manager' (3af5fa29-119a-46c9-8ab9-ace72392174d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b8ac73cd-9072-47e2-bc37-2c9f2019bef1 tempest-VolumeImageDependencyTests-1678689038 None] Created volume successfully. Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Acquiring lock "cinder-32b282eb-e996-44e0-903b-d768213e2a54-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Lock "cinder-32b282eb-e996-44e0-903b-d768213e2a54-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Acquiring lock "cinder-quobyte-32b282eb-e996-44e0-903b-d768213e2a54" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Lock "cinder-quobyte-32b282eb-e996-44e0-903b-d768213e2a54" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4f4232-6c8a-44c5-9e06-a47d785abc88]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:50 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 Sep 25 18:11:50 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:51 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54" returned: 0 in 0.350s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:51 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54 Sep 25 18:11:51 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:51 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-32b282eb-e996-44e0-903b-d768213e2a54" returned: 0 in 0.240s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Lock "cinder-quobyte-32b282eb-e996-44e0-903b-d768213e2a54" released by "delete_volume" :: held 0.630s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Created reservations ['dfab7c18-fa76-41a3-a02b-d5794aa9e5f1', '0624735a-70cf-469e-8c22-045a74a381ea', 'd64fb824-e839-48c1-af56-ad589abc3b64', '14de3371-87d7-4712-8a51-25f4688af2dc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:51 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:51 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:51 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.238s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Deleted volume successfully. Sep 25 18:11:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-8d4629df-cc72-4400-892a-edc7bc18741e tempest-VolumeImageDependencyTests-1678689038 None] Lock "cinder-32b282eb-e996-44e0-903b-d768213e2a54-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Flow 'volume_create_manager' (bc603a01-d262-40f2-b3c6-a86b289ed13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab8e565-a3cc-4e0b-81ab-c1442dd88540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab8e565-a3cc-4e0b-81ab-c1442dd88540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dc4c00-3848-4a11-9476-da50f6bf2313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782bfd6aee184aa9bb68718c9c345519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:55Z,use_quota=True,user_id='8842038537594b538300f184d6188309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7bfd55-8ac7-4b01-81fa-984fd2cf6ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7bfd55-8ac7-4b01-81fa-984fd2cf6ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2bd064-585d-4447-8276-536b15b9bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2bd064-585d-4447-8276-536b15b9bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70dc4c00-3848-4a11-9476-da50f6bf2313', 'volume_name': 'volume-70dc4c00-3848-4a11-9476-da50f6bf2313', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c050c0-f917-48e4-bb24-988991991834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c050c0-f917-48e4-bb24-988991991834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1221571-1fe3-4e37-b876-e278025a2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:54 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Volume 70dc4c00-3848-4a11-9476-da50f6bf2313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70dc4c00-3848-4a11-9476-da50f6bf2313', 'volume_size': 1} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dc4c00-3848-4a11-9476-da50f6bf2313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782bfd6aee184aa9bb68718c9c345519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:55Z,use_quota=True,user_id='8842038537594b538300f184d6188309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Creating volume 70dc4c00-3848-4a11-9476-da50f6bf2313 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:54 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:54 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 1073741824 Sep 25 18:11:54 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:55 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 1073741824" returned: 0 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:55 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 Sep 25 18:11:55 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:55 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1221571-1fe3-4e37-b876-e278025a2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70dc4c00-3848-4a11-9476-da50f6bf2313', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe32177-5f24-456a-92c0-3f58735a5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:55 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Volume volume-70dc4c00-3848-4a11-9476-da50f6bf2313 (70dc4c00-3848-4a11-9476-da50f6bf2313): created successfully Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe32177-5f24-456a-92c0-3f58735a5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Flow 'volume_create_manager' (bc603a01-d262-40f2-b3c6-a86b289ed13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1b491f33-747b-4ed9-9c1e-600acb2bdf1a tempest-CinderUnicodeTest-1083155931 None] Created volume successfully. Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:55 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:11:55 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:11:56 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Flow 'volume_create_manager' (66907af4-d1d8-4c2d-bbbe-5ef67b4a92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7497597f-13e4-4f80-9432-acb8b8f4d56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.284s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7497597f-13e4-4f80-9432-acb8b8f4d56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-333077234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3eeb10-1863-4d9b-b670-d7c9ad733b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782bfd6aee184aa9bb68718c9c345519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:56Z,use_quota=True,user_id='8842038537594b538300f184d6188309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3cf4f3-0fd8-4da0-a1ed-ff971edffa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3cf4f3-0fd8-4da0-a1ed-ff971edffa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf1dcca-5060-4beb-b87a-ce93df66fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf1dcca-5060-4beb-b87a-ce93df66fa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3eeb10-1863-4d9b-b670-d7c9ad733b4d', 'volume_name': 'volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f254c5d-b0c8-4bb0-a4b5-844c139dc5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f254c5d-b0c8-4bb0-a4b5-844c139dc5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9274b7-e5c1-4b56-b325-108419fe0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:56 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Volume df3eeb10-1863-4d9b-b670-d7c9ad733b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d', 'volume_size': 1} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:11:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-333077234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3eeb10-1863-4d9b-b670-d7c9ad733b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782bfd6aee184aa9bb68718c9c345519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:11:56Z,use_quota=True,user_id='8842038537594b538300f184d6188309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Creating volume df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:11:56 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:56 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d 1073741824 Sep 25 18:11:56 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:56 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d 1073741824" returned: 0 in 0.403s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:56 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d Sep 25 18:11:56 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:56 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9274b7-e5c1-4b56-b325-108419fe0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b320282a-d4eb-47a2-aa66-a979fadf37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:11:56 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Volume volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d (df3eeb10-1863-4d9b-b670-d7c9ad733b4d): created successfully Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b320282a-d4eb-47a2-aa66-a979fadf37cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:11:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Flow 'volume_create_manager' (66907af4-d1d8-4c2d-bbbe-5ef67b4a92b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:11:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4072a6c8-ef75-496f-87b0-a243e7c7072b tempest-CinderUnicodeTest-1083155931 None] Created volume successfully. Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Creating offline snapshot 98b2e913-34a0-4a26-a9ac-801f582b55b1 of volume df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9ed10-542c-4560-a409-268f117e8e9c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:57 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d Sep 25 18:11:57 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:57 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" returned: 0 in 0.358s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:57 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 1G Sep 25 18:11:57 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:58 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 1G" returned: 0 in 0.383s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:58 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 Sep 25 18:11:58 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:58 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1" returned: 0 in 0.291s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:58 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 is being set with open permissions: ugo+rw Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:58 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 Sep 25 18:11:58 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:58 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:58 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info Sep 25 18:11:58 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:58 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info" returned: 0 in 0.243s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:58 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info is being set with open permissions: ugo+rw Sep 25 18:11:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:59 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info Sep 25 18:11:59 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:59 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.info" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:11:59 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-22dfce19-85ee-440d-b9d1-ac42d6821c15 tempest-CinderUnicodeTest-1083155931 None] Create snapshot completed successfully Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-98b2e913-34a0-4a26-a9ac-801f582b55b1-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-98b2e913-34a0-4a26-a9ac-801f582b55b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-quobyte-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-quobyte-98b2e913-34a0-4a26-a9ac-801f582b55b1" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-98b2e913-34a0-4a26-a9ac-801f582b55b1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Deleting offline snapshot 98b2e913-34a0-4a26-a9ac-801f582b55b1 of volume df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] snapshot_file for this snap is: volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9708a39c-f257-4636-9446-6cd965eeba89]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:11:59 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 Sep 25 18:11:59 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:11:59 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1" returned: 0 in 0.356s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c81e4e2-4562-480c-813f-90f388eb93e9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:11:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:00 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d Sep 25 18:12:00 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:00 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" returned: 0 in 0.361s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:00 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 Sep 25 18:12:00 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:00 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1" returned: 0 in 0.331s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:00 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1 Sep 25 18:12:00 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:00 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d.98b2e913-34a0-4a26-a9ac-801f582b55b1" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-98b2e913-34a0-4a26-a9ac-801f582b55b1" released by "_delete_snapshot" :: held 1.393s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" released by "delete_snapshot" :: held 1.412s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Created reservations ['1b92e04c-4e35-42a6-955e-df3a636d4308', '8d56b0d6-f9a1-4904-928d-baf13a9bd99a', '530ccda6-ce6e-4e53-825b-ab5f3e4a8a88', 'a1cf99f6-5c02-4bfe-808e-130a6f00c60d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:01 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Delete snapshot completed successfully. Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-7900c60c-2415-46d8-a197-7e2766e7723a tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-98b2e913-34a0-4a26-a9ac-801f582b55b1-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-df3eeb10-1863-4d9b-b670-d7c9ad733b4d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-df3eeb10-1863-4d9b-b670-d7c9ad733b4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-quobyte-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b26443-aa00-4114-acf8-238b7477db70]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:01 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d Sep 25 18:12:01 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:02 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" returned: 0 in 0.359s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:02 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d Sep 25 18:12:02 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:02 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-df3eeb10-1863-4d9b-b670-d7c9ad733b4d" released by "delete_volume" :: held 0.670s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Created reservations ['d9be2028-db4a-4058-b3b5-e2a8475ae541', 'e9980a57-2897-4d6f-ba85-db23be28ba8f', '287b4775-ad0c-46c4-aca6-22dc2df9fa5e', 'e2e7488a-4d35-42a1-9261-69c0871efdfa'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:02 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:02 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:02 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Deleted volume successfully. Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-018f5be2-e980-46b4-9fe8-1d11ddeb608c tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-df3eeb10-1863-4d9b-b670-d7c9ad733b4d-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-70dc4c00-3848-4a11-9476-da50f6bf2313-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-70dc4c00-3848-4a11-9476-da50f6bf2313-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "cinder-quobyte-70dc4c00-3848-4a11-9476-da50f6bf2313" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-70dc4c00-3848-4a11-9476-da50f6bf2313" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[41470998-5eb2-478a-96de-182f4a47fd96]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:03 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 Sep 25 18:12:03 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:03 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:03 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313 Sep 25 18:12:03 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:03 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-70dc4c00-3848-4a11-9476-da50f6bf2313" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-quobyte-70dc4c00-3848-4a11-9476-da50f6bf2313" released by "delete_volume" :: held 0.654s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Created reservations ['7ebe051c-44c3-4636-b7d9-c078cb9ffb82', '88a826fa-a0a9-4c6d-a362-020afdf8fa8e', '4d661b3b-2aef-40df-b9d8-541c7d0e15fa', '5e777ab5-ca15-43b3-b272-38243cd47cb7'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:03 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:03 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:03 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:03 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Deleted volume successfully. Sep 25 18:12:03 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-dffd8380-af30-49db-8222-7afa09cbb238 tempest-CinderUnicodeTest-1083155931 None] Lock "cinder-70dc4c00-3848-4a11-9476-da50f6bf2313-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:13 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=97,cinder:UPDATE=135,cinder:INSERT=40,cinder:DELETE=14 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:12:13 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=107,cinder:UPDATE=138,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (1a2082f9-b252-49c2-8190-e08afd10a9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013e8552-0012-458f-a7e2-5ed70a2882e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013e8552-0012-458f-a7e2-5ed70a2882e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705236944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8995af1-04d2-4cd3-bf4c-52b08ee7da21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:24Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855453cf-52bf-4bd2-b42b-823704f09f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855453cf-52bf-4bd2-b42b-823704f09f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3381eb9e-9786-4ab9-b4ce-1064d2582a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3381eb9e-9786-4ab9-b4ce-1064d2582a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8995af1-04d2-4cd3-bf4c-52b08ee7da21', 'volume_name': 'volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cef5f75-6e58-4053-80a0-04aa42f7c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cef5f75-6e58-4053-80a0-04aa42f7c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672e96aa-5553-449a-9711-1f40da23ca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Volume c8995af1-04d2-4cd3-bf4c-52b08ee7da21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21', 'volume_size': 1} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705236944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8995af1-04d2-4cd3-bf4c-52b08ee7da21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:24Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Creating volume c8995af1-04d2-4cd3-bf4c-52b08ee7da21 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:23 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:23 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 1073741824 Sep 25 18:12:23 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (1079bf42-15c7-4389-9c9b-9b895ca50e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a5127c-02ac-4886-aa14-6ba837d0cba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a5127c-02ac-4886-aa14-6ba837d0cba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-282824711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743a8ae0-6e78-4d0f-82fc-4d7b000a0736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:24Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c30ade7-4534-44d1-869c-1c66f96bdc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c30ade7-4534-44d1-869c-1c66f96bdc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792b9529-b03d-4b41-b5c4-5ac4f1407a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792b9529-b03d-4b41-b5c4-5ac4f1407a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743a8ae0-6e78-4d0f-82fc-4d7b000a0736', 'volume_name': 'volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44eacaa-0cf3-4020-bc2f-b171086f8462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44eacaa-0cf3-4020-bc2f-b171086f8462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cf16a6-ccaa-419a-b238-104a6e109d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume 743a8ae0-6e78-4d0f-82fc-4d7b000a0736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736', 'volume_size': 1} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (bc46ec34-4056-4ec9-aa85-c34a8faf8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:24 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3505d2-48df-4a81-a5a1-ee8c5ed0f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 1073741824" returned: 0 in 0.633s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3505d2-48df-4a81-a5a1-ee8c5ed0f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489587745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b067b720-ba87-40fb-8741-9304ef83deb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:24Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7597fca-2963-4d43-afcc-1dedc4fe9e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7597fca-2963-4d43-afcc-1dedc4fe9e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d398aeac-d67d-4da6-bf4e-d990ed9dc325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d398aeac-d67d-4da6-bf4e-d990ed9dc325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b067b720-ba87-40fb-8741-9304ef83deb7', 'volume_name': 'volume-b067b720-ba87-40fb-8741-9304ef83deb7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73254a17-7431-4910-9b2d-aa0245f243e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73254a17-7431-4910-9b2d-aa0245f243e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9cc337-ed9a-418a-aa99-88973f1cdfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Volume b067b720-ba87-40fb-8741-9304ef83deb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b067b720-ba87-40fb-8741-9304ef83deb7', 'volume_size': 1} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (a0dcb4e7-55a5-4179-bc40-1d91bbcb8914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2849161f-c963-447d-bbcf-f492eba90895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 Sep 25 18:12:24 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2849161f-c963-447d-bbcf-f492eba90895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045321436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8162e1-c119-47e7-9bcf-06c10e1d70ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:25Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dc4fd8-6e00-47c7-87a6-4569a49f4849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dc4fd8-6e00-47c7-87a6-4569a49f4849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f957c2-21bf-4b73-9cdb-daaea8bdcf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f957c2-21bf-4b73-9cdb-daaea8bdcf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8162e1-c119-47e7-9bcf-06c10e1d70ff', 'volume_name': 'volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a5a5e5-217b-4ffe-aac6-64cac2955f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a5a5e5-217b-4ffe-aac6-64cac2955f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31009614-b638-4c98-9b73-7ec6937a9dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume 1f8162e1-c119-47e7-9bcf-06c10e1d70ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff', 'volume_size': 1} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (da4f5ea5-ef8c-4eca-81f0-4a917a7228e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989a101a-74f8-4a51-b9a4-623c845b395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989a101a-74f8-4a51-b9a4-623c845b395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-135822009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f5f603-6286-4944-b926-e58367c223be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:25Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f24d541-7685-4904-8d28-86c54bd1e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f24d541-7685-4904-8d28-86c54bd1e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe539be-0bf9-4b02-9db4-6bbbec95febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe539be-0bf9-4b02-9db4-6bbbec95febf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f5f603-6286-4944-b926-e58367c223be', 'volume_name': 'volume-d0f5f603-6286-4944-b926-e58367c223be', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee557fc0-869e-4e76-8755-7e076347d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee557fc0-869e-4e76-8755-7e076347d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e14fef-d449-47b8-8343-8fdd9e876b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Volume d0f5f603-6286-4944-b926-e58367c223be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f5f603-6286-4944-b926-e58367c223be', 'volume_size': 1} Sep 25 18:12:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:25 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21" returned: 0 in 0.492s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-282824711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743a8ae0-6e78-4d0f-82fc-4d7b000a0736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:24Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Creating volume 743a8ae0-6e78-4d0f-82fc-4d7b000a0736 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:25 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:25 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 1073741824 Sep 25 18:12:25 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672e96aa-5553-449a-9711-1f40da23ca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c687a6-2051-403e-8dd9-380bcba21b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (30713cc6-8311-46d4-aef0-99c52858a4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fa1004-cea3-4e64-8f11-04e53a3c5191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Volume volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 (c8995af1-04d2-4cd3-bf4c-52b08ee7da21): created successfully Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c687a6-2051-403e-8dd9-380bcba21b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (1a2082f9-b252-49c2-8190-e08afd10a9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-06e7ea2e-06bf-455a-a01b-39540fca9a15 tempest-CreateVolumesFromImageTest-573896361 None] Created volume successfully. Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fa1004-cea3-4e64-8f11-04e53a3c5191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374304403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137de7e4-ad28-4dec-a3de-a7debcde3315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:25Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb0e00e-eea1-4d13-a186-724ae9229446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb0e00e-eea1-4d13-a186-724ae9229446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16281c71-eaa4-425f-ad94-f3f53400c8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16281c71-eaa4-425f-ad94-f3f53400c8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137de7e4-ad28-4dec-a3de-a7debcde3315', 'volume_name': 'volume-137de7e4-ad28-4dec-a3de-a7debcde3315', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2bd5c7-ea89-4f9a-abd3-28c76ccb77ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2bd5c7-ea89-4f9a-abd3-28c76ccb77ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106b5357-54e8-43f3-99d9-474890dec7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Volume 137de7e4-ad28-4dec-a3de-a7debcde3315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137de7e4-ad28-4dec-a3de-a7debcde3315', 'volume_size': 1} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (3f42cec7-fcd1-4e10-a39c-18a2d2286cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c44624c-e1a7-4fe3-aed1-f26cc579b93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c44624c-e1a7-4fe3-aed1-f26cc579b93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847241815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698c63a3-bd13-4c03-be4e-63e6db9033a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:26Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fa2fe1-923f-48b1-86e9-0dba45e86e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fa2fe1-923f-48b1-86e9-0dba45e86e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c49469a-c800-484c-88c4-5b35b0765247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c49469a-c800-484c-88c4-5b35b0765247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698c63a3-bd13-4c03-be4e-63e6db9033a0', 'volume_name': 'volume-698c63a3-bd13-4c03-be4e-63e6db9033a0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4cff80-48a7-4580-ae97-0046b01cb105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4cff80-48a7-4580-ae97-0046b01cb105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73959be-7969-43cb-b9b5-d9e76d8bce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Volume 698c63a3-bd13-4c03-be4e-63e6db9033a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698c63a3-bd13-4c03-be4e-63e6db9033a0', 'volume_size': 1} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:25 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 1073741824" returned: 0 in 0.601s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:25 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 Sep 25 18:12:25 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:26 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736" returned: 0 in 0.262s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489587745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b067b720-ba87-40fb-8741-9304ef83deb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:24Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Creating volume b067b720-ba87-40fb-8741-9304ef83deb7 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:26 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cf16a6-ccaa-419a-b238-104a6e109d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:26 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 1073741824 Sep 25 18:12:26 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8547f0fb-4985-4359-b3c8-1d995723f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 (743a8ae0-6e78-4d0f-82fc-4d7b000a0736): created successfully Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8547f0fb-4985-4359-b3c8-1d995723f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (1079bf42-15c7-4389-9c9b-9b895ca50e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:26 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-591c9f67-3575-4b75-b5a0-ab412b67118c tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created volume successfully. Sep 25 18:12:26 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 1073741824" returned: 0 in 0.433s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:26 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 Sep 25 18:12:26 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:26 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045321436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8162e1-c119-47e7-9bcf-06c10e1d70ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:25Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating volume 1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:26 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9cc337-ed9a-418a-aa99-88973f1cdfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b067b720-ba87-40fb-8741-9304ef83deb7', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:26 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff 1073741824 Sep 25 18:12:26 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e0e8de-1a74-41c0-b8de-6a5f5fd66660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Volume volume-b067b720-ba87-40fb-8741-9304ef83deb7 (b067b720-ba87-40fb-8741-9304ef83deb7): created successfully Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e0e8de-1a74-41c0-b8de-6a5f5fd66660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (bc46ec34-4056-4ec9-aa85-c34a8faf8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:26 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6543722e-a58f-4388-b3ab-f87a4ab4616c tempest-CreateVolumesFromImageTest-573896361 None] Created volume successfully. Sep 25 18:12:27 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff 1073741824" returned: 0 in 0.495s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:27 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff Sep 25 18:12:27 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:27 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.674s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-135822009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f5f603-6286-4944-b926-e58367c223be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:25Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Creating volume d0f5f603-6286-4944-b926-e58367c223be {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:27 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31009614-b638-4c98-9b73-7ec6937a9dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c64da7f-a711-424c-845c-82e8fefd104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:27 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be 1073741824 Sep 25 18:12:27 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:27 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff (1f8162e1-c119-47e7-9bcf-06c10e1d70ff): created successfully Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c64da7f-a711-424c-845c-82e8fefd104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (a0dcb4e7-55a5-4179-bc40-1d91bbcb8914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-83332707-147f-458c-9061-15b6b39eb279 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created volume successfully. Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (2326c08e-452d-408d-a53f-81da5d747bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455df6a7-b4bc-4794-bc21-28af3030c353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455df6a7-b4bc-4794-bc21-28af3030c353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-238756616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5963cfea-a333-450a-b3aa-3805ff569b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:28Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba66d8d-03a4-4c7a-87ac-32a63704a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba66d8d-03a4-4c7a-87ac-32a63704a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787d0f14-e51b-42eb-a914-fe4adf55ed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787d0f14-e51b-42eb-a914-fe4adf55ed90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5963cfea-a333-450a-b3aa-3805ff569b79', 'volume_name': 'volume-5963cfea-a333-450a-b3aa-3805ff569b79', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1345e576-66e6-4f09-b444-9dcaf9850805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1345e576-66e6-4f09-b444-9dcaf9850805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad7cc4-0f7a-41ff-957f-cec188138b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume 5963cfea-a333-450a-b3aa-3805ff569b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5963cfea-a333-450a-b3aa-3805ff569b79', 'volume_size': 1} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Flow 'volume_create_manager' (557ee4d4-f8d4-486f-b379-fb95fe72ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45ebf95-a9dc-42db-a01d-f96ca5fe388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45ebf95-a9dc-42db-a01d-f96ca5fe388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053020a9d14491da8ad3cfd6fa6a28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:28Z,use_quota=True,user_id='50f2fbd4871a4c17b98cfc074eb08365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5371790-dffb-469e-a1fe-8e6735d47508),volume_type_id=d5371790-dffb-469e-a1fe-8e6735d47508)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b56edf-78a9-43cd-8535-f74a264d6db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b56edf-78a9-43cd-8535-f74a264d6db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df517c3a-c382-4922-87b3-2ce0bcc16451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:12:28 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be 1073741824" returned: 0 in 0.645s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (b26796b0-55ad-41e8-8f1f-aaecec12b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e107a265-0019-47d7-8a62-f72b601955e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e107a265-0019-47d7-8a62-f72b601955e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-923858773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:28Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d91395d-0871-4551-bd1b-8e6184c0da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d91395d-0871-4551-bd1b-8e6184c0da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8bee7c-f726-49d8-a20f-2c9a207b601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8bee7c-f726-49d8-a20f-2c9a207b601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8', 'volume_name': 'volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41b5ffd-2647-464b-86f5-af2cfca63347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41b5ffd-2647-464b-86f5-af2cfca63347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9f55eb-1e81-4fb2-b192-eb8dbb4c8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume 36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8', 'volume_size': 1} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df517c3a-c382-4922-87b3-2ce0bcc16451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12', 'volume_name': 'volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12', 'volume_size': 1, 'image_id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53ffb116-a1da-4196-bb48-e935e1ba07e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d5f1cdc94bb846b06a1fa65a781e352', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8053020a9d14491da8ad3cfd6fa6a28b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5861ecd6eead38ae65a023ec839717ae483cd456443a7fd620cb6ebdb85b163c61a0bffd894ed50ed9cb3ac48ef6fe92480063fece06283102a8b4e7ceaaf722', 'id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'created_at': datetime.datetime(2026, 9, 25, 16, 12, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 12, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53ffb116-a1da-4196-bb48-e935e1ba07e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4393e2cc-90eb-4660-b2dd-76a658acf8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4393e2cc-90eb-4660-b2dd-76a658acf8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff232cf8-7180-4bc7-8b95-a98e48b2fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Volume 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12', 'volume_size': 1, 'image_id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53ffb116-a1da-4196-bb48-e935e1ba07e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d5f1cdc94bb846b06a1fa65a781e352', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8053020a9d14491da8ad3cfd6fa6a28b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5861ecd6eead38ae65a023ec839717ae483cd456443a7fd620cb6ebdb85b163c61a0bffd894ed50ed9cb3ac48ef6fe92480063fece06283102a8b4e7ceaaf722', 'id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'created_at': datetime.datetime(2026, 9, 25, 16, 12, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 12, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53ffb116-a1da-4196-bb48-e935e1ba07e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Trying to clone 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 from image 53ffb116-a1da-4196-bb48-e935e1ba07e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/53ffb116-a1da-4196-bb48-e935e1ba07e0', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (9304a5ed-7a2d-46ab-a99f-0ea14f4661a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569a0e1-968c-42ae-83d5-3d0d402700e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5569a0e1-968c-42ae-83d5-3d0d402700e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221722178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f409a9-bc52-42c9-adde-a0de26fbf81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:29Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc522fa-6fad-4888-abf0-f9c82fcd35d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc522fa-6fad-4888-abf0-f9c82fcd35d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeffcb00-98dc-4843-9405-3a850ce076df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeffcb00-98dc-4843-9405-3a850ce076df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f409a9-bc52-42c9-adde-a0de26fbf81e', 'volume_name': 'volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41722caa-edca-4b54-abe2-4c270e276877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41722caa-edca-4b54-abe2-4c270e276877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4944d9-c810-4c40-92b3-e617cd9d8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume d0f409a9-bc52-42c9-adde-a0de26fbf81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e', 'volume_size': 1} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Image download 0.00 MB at 0.00 MB/s Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374304403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137de7e4-ad28-4dec-a3de-a7debcde3315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:25Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Creating volume 137de7e4-ad28-4dec-a3de-a7debcde3315 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:28 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 1073741824 Sep 25 18:12:28 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e14fef-d449-47b8-8343-8fdd9e876b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f5f603-6286-4944-b926-e58367c223be', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b5b245-c4b9-4bfd-b3d1-087d6c640fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dee15e-559f-4aa5-b8f8-d27eca454dbd]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Volume volume-d0f5f603-6286-4944-b926-e58367c223be (d0f5f603-6286-4944-b926-e58367c223be): created successfully Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b5b245-c4b9-4bfd-b3d1-087d6c640fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:28 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (da4f5ea5-ef8c-4eca-81f0-4a917a7228e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-608c6d47-88f6-482c-886c-7252f39b1839 tempest-CreateVolumesFromImageTest-573896361 None] Created volume successfully. Sep 25 18:12:28 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD Sep 25 18:12:28 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (dbac947f-053c-4f29-b869-55c4c0e91707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7b1720-8f73-4024-a598-9060eea30738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7b1720-8f73-4024-a598-9060eea30738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-627738682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3709af97-5b5d-4fe2-9d8f-f2306c70f26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:29Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11d0149-0b2b-4e93-a8e9-2ae2032ffff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11d0149-0b2b-4e93-a8e9-2ae2032ffff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57058b79-aa6f-4296-b0b8-33eba4477255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57058b79-aa6f-4296-b0b8-33eba4477255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3709af97-5b5d-4fe2-9d8f-f2306c70f26d', 'volume_name': 'volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb3696a-87f4-4460-a05a-5809a2ee9f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb3696a-87f4-4460-a05a-5809a2ee9f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013293aa-079e-49dd-b2c1-2aa6d6ad0520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume 3709af97-5b5d-4fe2-9d8f-f2306c70f26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d', 'volume_size': 1} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:29 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:29 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD Sep 25 18:12:29 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:29 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 1073741824" returned: 0 in 0.712s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:29 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 Sep 25 18:12:29 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:29 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Temporary image 53ffb116-a1da-4196-bb48-e935e1ba07e0 is fetched for user 50f2fbd4871a4c17b98cfc074eb08365. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (827d504a-a145-48b2-a81f-992d722592d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a41377-8b13-4534-af26-b68386cbc633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a41377-8b13-4534-af26-b68386cbc633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652246552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa825b8-8138-4f8f-9793-e5b48324153d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:30Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffaa6c3b-7fb7-4ba7-b87f-e63ee5ac0698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffaa6c3b-7fb7-4ba7-b87f-e63ee5ac0698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2a624e-fd29-4768-bb2e-b09be34b9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2a624e-fd29-4768-bb2e-b09be34b9c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa825b8-8138-4f8f-9793-e5b48324153d', 'volume_name': 'volume-afa825b8-8138-4f8f-9793-e5b48324153d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e750f464-e306-4fd5-afcc-1d3d286375d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e750f464-e306-4fd5-afcc-1d3d286375d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99d49d4-8c0a-457f-b696-6d4f9c050d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume afa825b8-8138-4f8f-9793-e5b48324153d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa825b8-8138-4f8f-9793-e5b48324153d', 'volume_size': 1} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315" returned: 0 in 0.301s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.080s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1847241815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698c63a3-bd13-4c03-be4e-63e6db9033a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1862604592e54237ad4a813dc5feadc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:26Z,use_quota=True,user_id='dc6505d94ea84015a4d8da6205bc2cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Creating volume 698c63a3-bd13-4c03-be4e-63e6db9033a0 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:29 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:29 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 1073741824 Sep 25 18:12:29 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106b5357-54e8-43f3-99d9-474890dec7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137de7e4-ad28-4dec-a3de-a7debcde3315', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df52a5ea-b852-4642-8683-c1656da89d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd7df17-ec87-4557-aeaa-3d4d54ba794f]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Volume volume-137de7e4-ad28-4dec-a3de-a7debcde3315 (137de7e4-ad28-4dec-a3de-a7debcde3315): created successfully Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df52a5ea-b852-4642-8683-c1656da89d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (30713cc6-8311-46d4-aef0-99c52858a4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-33d325ee-f689-4894-9cb3-c13ec0014b6f tempest-CreateVolumesFromImageTest-573896361 None] Created volume successfully. Sep 25 18:12:30 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD Sep 25 18:12:30 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:30 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:30 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 1073741824" returned: 0 in 0.433s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:30 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 Sep 25 18:12:30 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:30 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD Sep 25 18:12:30 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:30 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0" returned: 0 in 0.270s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.567s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-238756616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5963cfea-a333-450a-b3aa-3805ff569b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:28Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Creating volume 5963cfea-a333-450a-b3aa-3805ff569b79 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:30 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:30 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:30 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 1073741824 Sep 25 18:12:30 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73959be-7969-43cb-b9b5-d9e76d8bce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698c63a3-bd13-4c03-be4e-63e6db9033a0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33362b8e-9160-413c-8f1f-5101e2b55dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Volume volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 (698c63a3-bd13-4c03-be4e-63e6db9033a0): created successfully Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33362b8e-9160-413c-8f1f-5101e2b55dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Flow 'volume_create_manager' (3f42cec7-fcd1-4e10-a39c-18a2d2286cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2eb22326-bd6f-4dcb-bd50-cae47849135f tempest-CreateVolumesFromImageTest-573896361 None] Created volume successfully. Sep 25 18:12:31 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 1073741824" returned: 0 in 0.426s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:31 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 Sep 25 18:12:31 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:31 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-923858773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:28Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Creating volume 36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:31 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad7cc4-0f7a-41ff-957f-cec188138b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5963cfea-a333-450a-b3aa-3805ff569b79', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:31 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 1073741824 Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a41fd20-1a90-40b5-9d20-86ef83c8a3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:31 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:31 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume volume-5963cfea-a333-450a-b3aa-3805ff569b79 (5963cfea-a333-450a-b3aa-3805ff569b79): created successfully Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a41fd20-1a90-40b5-9d20-86ef83c8a3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (2326c08e-452d-408d-a53f-81da5d747bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d48d5d3c-fd80-4c26-ad9b-1dc42e5929e1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created volume successfully. Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-698c63a3-bd13-4c03-be4e-63e6db9033a0-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-698c63a3-bd13-4c03-be4e-63e6db9033a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-quobyte-698c63a3-bd13-4c03-be4e-63e6db9033a0" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-698c63a3-bd13-4c03-be4e-63e6db9033a0" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5939ef12-ff17-4ebd-b406-a23095b4cdb2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:31 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 1073741824" returned: 0 in 0.507s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:31 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 Sep 25 18:12:31 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:31 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 Sep 25 18:12:31 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:32 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.373s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221722178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f409a9-bc52-42c9-adde-a0de26fbf81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:29Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Creating volume d0f409a9-bc52-42c9-adde-a0de26fbf81e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:32 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:32 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e 1073741824 Sep 25 18:12:32 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9f55eb-1e81-4fb2-b192-eb8dbb4c8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a49dbb4-b227-446e-9f22-cdb50a7dac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:32 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0 Sep 25 18:12:32 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 (36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8): created successfully Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a49dbb4-b227-446e-9f22-cdb50a7dac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (b26796b0-55ad-41e8-8f1f-aaecec12b12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-44e0acd6-ba1d-42fc-9ab6-00ea1a2bda30 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created volume successfully. Sep 25 18:12:32 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-698c63a3-bd13-4c03-be4e-63e6db9033a0" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-698c63a3-bd13-4c03-be4e-63e6db9033a0" released by "delete_volume" :: held 0.697s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Created reservations ['d08a859e-e6bb-45de-9fa6-67c2ccc2c5f9', '39c8aa4d-77a1-4482-ad48-4d4a71e63170', '01713897-e1ae-43b7-8d2f-fe706a3bec4a', '3c6fe6a7-6227-450e-a4e2-25ef071c73f3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:32 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:32 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:32 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e 1073741824" returned: 0 in 0.447s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:32 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e Sep 25 18:12:32 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:32 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.273s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-137de7e4-ad28-4dec-a3de-a7debcde3315-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Deleted volume successfully. Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-137de7e4-ad28-4dec-a3de-a7debcde3315-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f3823533-f3b3-4423-b562-b8800a58cef7 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-698c63a3-bd13-4c03-be4e-63e6db9033a0-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:32 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-quobyte-137de7e4-ad28-4dec-a3de-a7debcde3315" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.667s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-627738682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3709af97-5b5d-4fe2-9d8f-f2306c70f26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:29Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Creating volume 3709af97-5b5d-4fe2-9d8f-f2306c70f26d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4944d9-c810-4c40-92b3-e617cd9d8db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270d5eb3-61bd-40b5-8047-295e187d18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:32 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d 1073741824 Sep 25 18:12:32 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-137de7e4-ad28-4dec-a3de-a7debcde3315" acquired by "delete_volume" :: waited 0.064s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:32 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e (d0f409a9-bc52-42c9-adde-a0de26fbf81e): created successfully Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270d5eb3-61bd-40b5-8047-295e187d18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (9304a5ed-7a2d-46ab-a99f-0ea14f4661a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[add8cd96-ef53-4b43-8e60-28c74f62f930]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b9fa6574-b9ce-481c-afa9-366c1976e7b3 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created volume successfully. Sep 25 18:12:33 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 Sep 25 18:12:33 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:33 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d 1073741824" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:33 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315" returned: 0 in 0.397s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:33 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315 Sep 25 18:12:33 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:33 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d Sep 25 18:12:33 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:33 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-137de7e4-ad28-4dec-a3de-a7debcde3315" returned: 0 in 0.252s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-137de7e4-ad28-4dec-a3de-a7debcde3315" released by "delete_volume" :: held 0.703s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:33 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d" returned: 0 in 0.259s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.262s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating offline snapshot 7ad90464-7164-4a6a-b588-7072ede2436e of volume 1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013293aa-079e-49dd-b2c1-2aa6d6ad0520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316c6383-de95-405b-b2ce-f2eef1ffd71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13b919-5726-4e8d-a013-f1830a958770]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:33 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d (3709af97-5b5d-4fe2-9d8f-f2306c70f26d): created successfully Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316c6383-de95-405b-b2ce-f2eef1ffd71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (dbac947f-053c-4f29-b869-55c4c0e91707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a03d976f-6f71-4fa9-b513-7a305e4ae5bf tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created volume successfully. Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Created reservations ['9c158fa6-3beb-43dd-b969-cd9544740eef', 'adc7bfc0-102a-41c6-ad47-c652127e52b4', 'd42d88ce-0606-4c82-a2c1-c5b72a734bc1', '1866a8ed-f9e9-417e-a30d-59c4291c2f23'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:33 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff Sep 25 18:12:33 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:33 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:33 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-d0f5f603-6286-4944-b926-e58367c223be-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-d0f5f603-6286-4944-b926-e58367c223be-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-quobyte-d0f5f603-6286-4944-b926-e58367c223be" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-d0f5f603-6286-4944-b926-e58367c223be" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf013e-2894-4091-bb0f-f594346f79cf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:34 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.342s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:34 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" returned: 0 in 0.482s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Deleted volume successfully. Sep 25 18:12:34 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e 1G Sep 25 18:12:34 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-75be3617-ec20-48ad-a248-915fd7a1983f tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-137de7e4-ad28-4dec-a3de-a7debcde3315-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:34 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be Sep 25 18:12:34 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:34 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:34 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be Sep 25 18:12:34 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:34 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e 1G" returned: 0 in 0.459s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:34 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e Sep 25 18:12:34 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:34 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f5f603-6286-4944-b926-e58367c223be" returned: 0 in 0.263s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-d0f5f603-6286-4944-b926-e58367c223be" released by "delete_volume" :: held 0.730s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Created reservations ['be19b5b3-0393-48f0-9138-2ea81727d70d', '1cfa8b59-903b-40d5-bc19-776be0ecafcf', 'ab8727f6-d6c2-486f-b69b-f78523067e78', '15ce91c9-e58b-4632-9517-b84e9c6aeab7'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:34 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e" returned: 0 in 0.310s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:34 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e is being set with open permissions: ugo+rw Sep 25 18:12:34 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:34 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e Sep 25 18:12:35 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-b067b720-ba87-40fb-8741-9304ef83deb7-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-b067b720-ba87-40fb-8741-9304ef83deb7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:35 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.300s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-quobyte-b067b720-ba87-40fb-8741-9304ef83deb7" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Deleted volume successfully. Sep 25 18:12:35 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e" returned: 0 in 0.317s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-b067b720-ba87-40fb-8741-9304ef83deb7" acquired by "delete_volume" :: waited 0.042s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6863ca0f-7be4-4d4a-aeaa-26d250f7a213 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-d0f5f603-6286-4944-b926-e58367c223be-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd6085b-ebd9-4b1a-b0e2-d750c5ec9cbf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:35 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info Sep 25 18:12:35 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 Sep 25 18:12:35 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:35 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info is being set with open permissions: ugo+rw Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:35 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info Sep 25 18:12:35 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7" returned: 0 in 0.385s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:35 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7 Sep 25 18:12:35 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.info" returned: 0 in 0.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.089s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652246552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa825b8-8138-4f8f-9793-e5b48324153d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e48f21436914430b39f7b0b333b7223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:30Z,use_quota=True,user_id='acc91d66672f4d73aa16e28ee753c8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Creating volume afa825b8-8138-4f8f-9793-e5b48324153d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:35 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:35 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d 1073741824 Sep 25 18:12:35 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0fb27e50-8fe6-4e1c-b08b-691fd9f48ecd tempest-CreateVolumesFromSnapshotTest-96776337 None] Create snapshot completed successfully Sep 25 18:12:35 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-b067b720-ba87-40fb-8741-9304ef83deb7" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-b067b720-ba87-40fb-8741-9304ef83deb7" released by "delete_volume" :: held 0.705s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Created reservations ['c3ac1ccb-3a80-45d4-8f86-08038e5f9506', '37d8224f-7ae4-4583-a1b8-912bee8e97e8', '102320a8-6fae-4152-91ba-a8300d6d1295', 'c1240049-b98c-4caf-8b87-11baed5ca323'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:36 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:36 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:36 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-c8995af1-04d2-4cd3-bf4c-52b08ee7da21-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Deleted volume successfully. Sep 25 18:12:36 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-c8995af1-04d2-4cd3-bf4c-52b08ee7da21-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d 1073741824" returned: 0 in 0.520s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f55d7901-1eff-4d3f-9e86-05584507465d tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-b067b720-ba87-40fb-8741-9304ef83deb7-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "cinder-quobyte-c8995af1-04d2-4cd3-bf4c-52b08ee7da21" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:36 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d Sep 25 18:12:36 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-c8995af1-04d2-4cd3-bf4c-52b08ee7da21" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a5e91d-3c02-46c1-9855-cae2a9b162b2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:36 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 Sep 25 18:12:36 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:36 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.139s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053020a9d14491da8ad3cfd6fa6a28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:28Z,use_quota=True,user_id='50f2fbd4871a4c17b98cfc074eb08365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5371790-dffb-469e-a1fe-8e6735d47508),volume_type_id=d5371790-dffb-469e-a1fe-8e6735d47508)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Creating volume 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:36 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:36 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 1073741824 Sep 25 18:12:36 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99d49d4-8c0a-457f-b696-6d4f9c050d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa825b8-8138-4f8f-9793-e5b48324153d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4c930f-50b9-4aa7-a336-299bce072c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:36 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Volume volume-afa825b8-8138-4f8f-9793-e5b48324153d (afa825b8-8138-4f8f-9793-e5b48324153d): created successfully Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4c930f-50b9-4aa7-a336-299bce072c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Flow 'volume_create_manager' (827d504a-a145-48b2-a81f-992d722592d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-13ac3150-948b-4d27-b2a7-4f39e4efa515 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created volume successfully. Sep 25 18:12:36 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21" returned: 0 in 0.399s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:36 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21 Sep 25 18:12:36 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:37 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:37 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c8995af1-04d2-4cd3-bf4c-52b08ee7da21" returned: 0 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 1073741824" returned: 0 in 0.498s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (a4aeac88-17c9-41bf-9c89-422082de559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99807015-43f5-4535-8c0f-2371cd3a5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-quobyte-c8995af1-04d2-4cd3-bf4c-52b08ee7da21" released by "delete_volume" :: held 0.804s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99807015-43f5-4535-8c0f-2371cd3a5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573011181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01367193-7360-4cd3-a34c-1701e2d26d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:37Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295155b5-0553-4194-b8f3-8cb364409b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295155b5-0553-4194-b8f3-8cb364409b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cfca5a-da20-417c-ae75-9ea6e9b3611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cfca5a-da20-417c-ae75-9ea6e9b3611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01367193-7360-4cd3-a34c-1701e2d26d03', 'volume_name': 'volume-01367193-7360-4cd3-a34c-1701e2d26d03', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9ef09d-7e1b-4685-ae56-98670aad4f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9ef09d-7e1b-4685-ae56-98670aad4f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3f6478-0129-4b78-bee6-f91ca9ab3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:37 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume 01367193-7360-4cd3-a34c-1701e2d26d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01367193-7360-4cd3-a34c-1701e2d26d03', 'volume_size': 1} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:37 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 Sep 25 18:12:37 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Created reservations ['982b67a2-b6b8-4d72-b0a7-731e4b10df44', '2598c572-5115-4c94-9191-1e23d17a4b15', '400b7d6d-e256-4bd2-a25d-ef2312a2a3df', '0a4821e1-23da-43dc-ab6e-302b9c7df3ce'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-afa825b8-8138-4f8f-9793-e5b48324153d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-afa825b8-8138-4f8f-9793-e5b48324153d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:37 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:37 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-quobyte-afa825b8-8138-4f8f-9793-e5b48324153d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-afa825b8-8138-4f8f-9793-e5b48324153d" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e679b-97fc-4d67-9258-d564919b72c1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:37 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" returned: 0 in 0.467s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573011181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01367193-7360-4cd3-a34c-1701e2d26d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:37Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating volume 01367193-7360-4cd3-a34c-1701e2d26d03 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:37 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:37 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 1073741824 Sep 25 18:12:37 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (202b06d8-620d-48b0-aa6c-047c44b6b29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9378b8-ce2e-438b-b242-c86db212d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9378b8-ce2e-438b-b242-c86db212d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903921561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4c9f75-41d1-433d-98f4-9e92d460f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:38Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb3880c-30dd-47ff-a21a-2cbe2dd5d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb3880c-30dd-47ff-a21a-2cbe2dd5d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d Sep 25 18:12:38 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9cf63a4-393a-4b93-82f5-2fb3519721d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9cf63a4-393a-4b93-82f5-2fb3519721d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4c9f75-41d1-433d-98f4-9e92d460f785', 'volume_name': 'volume-ed4c9f75-41d1-433d-98f4-9e92d460f785', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1ee7b7-155f-461e-862d-8b0b4abf784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1ee7b7-155f-461e-862d-8b0b4abf784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82588773-bf85-4052-89d2-7b3d5677007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume ed4c9f75-41d1-433d-98f4-9e92d460f785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4c9f75-41d1-433d-98f4-9e92d460f785', 'volume_size': 1} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.502s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:38 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Deleted volume successfully. Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Attempting download of 53ffb116-a1da-4196-bb48-e935e1ba07e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/53ffb116-a1da-4196-bb48-e935e1ba07e0', 'metadata': {}}])) to volume 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-30e599da-378e-4b9c-bd5d-362d749aeb47 tempest-CreateVolumesFromImageTest-573896361 None] Lock "cinder-c8995af1-04d2-4cd3-bf4c-52b08ee7da21-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66dada-e1e4-4c93-bcdf-ef779cd69fd6]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (53ee2ddc-405e-4938-9cbd-191e26247f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8373fc-8ada-4b99-b368-3ce67800f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8373fc-8ada-4b99-b368-3ce67800f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620511648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99759151-5ab5-42c3-bdbc-a4fe0e1ebeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:38Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5448d972-62df-47eb-98c2-4a4c39a92100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5448d972-62df-47eb-98c2-4a4c39a92100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c Sep 25 18:12:38 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e479c9-8c4a-4a2e-93db-385c95eff026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e479c9-8c4a-4a2e-93db-385c95eff026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99759151-5ab5-42c3-bdbc-a4fe0e1ebeab', 'volume_name': 'volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d832f8e0-aacb-40a7-92d3-27eb28096444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d832f8e0-aacb-40a7-92d3-27eb28096444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75a9bc0-2f50-4a6b-a7de-2434138366ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume 99759151-5ab5-42c3-bdbc-a4fe0e1ebeab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab', 'volume_size': 1} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d" returned: 0 in 0.780s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:38 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 1073741824" returned: 0 in 0.753s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:38 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d Sep 25 18:12:38 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:38 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 Sep 25 18:12:38 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (9fbb79fd-2caf-474e-b9cf-3b01fda92851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202c6465-5434-442c-8dcd-24bf2dd32a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:38 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c" returned: 0 in 0.635s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202c6465-5434-442c-8dcd-24bf2dd32a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249636040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:39Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf27355-f7ec-4e04-ac14-bfa26495b2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf27355-f7ec-4e04-ac14-bfa26495b2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a9a43c-cc1a-4da2-b35f-6993761c195d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a9a43c-cc1a-4da2-b35f-6993761c195d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af', 'volume_name': 'volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e277c26-619e-4f69-b868-7ed26c5c7f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e277c26-619e-4f69-b868-7ed26c5c7f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af10f8d-1e23-42d1-bdaa-00faab3895d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af', 'volume_size': 1} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:39 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c Sep 25 18:12:39 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:39 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-afa825b8-8138-4f8f-9793-e5b48324153d" returned: 0 in 0.527s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-afa825b8-8138-4f8f-9793-e5b48324153d" released by "delete_volume" :: held 1.395s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:39 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03" returned: 0 in 0.489s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903921561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4c9f75-41d1-433d-98f4-9e92d460f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:38Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating volume ed4c9f75-41d1-433d-98f4-9e92d460f785 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:39 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:39 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 1073741824 Sep 25 18:12:39 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3f6478-0129-4b78-bee6-f91ca9ab3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01367193-7360-4cd3-a34c-1701e2d26d03', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd9e9f3-d567-4d43-a4ba-90a58333da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c" returned: 1 in 0.426s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ffb116-a1da-4196-bb48-e935e1ba07e0_ciz99o1c' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:12:39 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume volume-01367193-7360-4cd3-a34c-1701e2d26d03 (01367193-7360-4cd3-a34c-1701e2d26d03): created successfully Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd9e9f3-d567-4d43-a4ba-90a58333da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (a4aeac88-17c9-41bf-9c89-422082de559f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2990bbf1-90db-488e-a7cc-c7d6d3d7252f]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created reservations ['0eb7e790-6e39-4fb1-97f0-337e0acad7ab', '0ae1c8d7-bf6e-4acc-abb7-482371b69f25', '85cc1759-ee2d-4d5d-9cc9-3ceb11a9f2c3', 'cc985078-4343-4b08-8e38-7e14098b9884'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:39 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6162a00b-d2d2-471e-832e-35eb150bc402 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created volume successfully. Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:39 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD Sep 25 18:12:39 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:39 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:39 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (12547ab4-4c05-430d-883f-6342729026cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f2771b-10a5-4eae-aa7f-4497f5186bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f2771b-10a5-4eae-aa7f-4497f5186bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1933945739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e785299d-b2c5-41bd-ab06-4f9b3ce07c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:40Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24753591-67ad-4e25-89f0-4fe2dda2cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24753591-67ad-4e25-89f0-4fe2dda2cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fcd563-0448-4a9a-8cad-0966ca5b2177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fcd563-0448-4a9a-8cad-0966ca5b2177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e785299d-b2c5-41bd-ab06-4f9b3ce07c3c', 'volume_name': 'volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8da5a2-56be-4321-a8cd-a1861c6e0534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8da5a2-56be-4321-a8cd-a1861c6e0534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f57792d-8867-47f4-aca9-2098ab44eb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:39 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume e785299d-b2c5-41bd-ab06-4f9b3ce07c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c', 'volume_size': 1} Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:39 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 1073741824" returned: 0 in 0.744s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-3709af97-5b5d-4fe2-9d8f-f2306c70f26d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-3709af97-5b5d-4fe2-9d8f-f2306c70f26d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:40 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:40 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.459s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:40 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 Sep 25 18:12:40 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Deleted volume successfully. Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-quobyte-3709af97-5b5d-4fe2-9d8f-f2306c70f26d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-3709af97-5b5d-4fe2-9d8f-f2306c70f26d" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-880270f5-2b9d-4497-98c0-48eea6b56c17 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-afa825b8-8138-4f8f-9793-e5b48324153d-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f71885-5855-487f-8c1b-7a39aa73e684]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:40 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD Sep 25 18:12:40 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:40 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d Sep 25 18:12:40 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:40 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785" returned: 0 in 0.536s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.999s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620511648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99759151-5ab5-42c3-bdbc-a4fe0e1ebeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:38Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating volume 99759151-5ab5-42c3-bdbc-a4fe0e1ebeab {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:40 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:40 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD" returned: 1 in 0.543s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] 53ffb116-a1da-4196-bb48-e935e1ba07e0 was raw, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:40 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab 1073741824 Sep 25 18:12:40 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82588773-bf85-4052-89d2-7b3d5677007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4c9f75-41d1-433d-98f4-9e92d460f785', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128d1721-97f5-4592-8c96-e59801ad0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:40 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 Sep 25 18:12:40 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 (ed4c9f75-41d1-433d-98f4-9e92d460f785): created successfully Sep 25 18:12:40 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128d1721-97f5-4592-8c96-e59801ad0a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (202b06d8-620d-48b0-aa6c-047c44b6b29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:40 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3dcf593a-f7be-4720-8f16-3684f2668d4b tempest-CreateVolumesFromSnapshotTest-96776337 None] Created volume successfully. Sep 25 18:12:40 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:40 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d Sep 25 18:12:40 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:41 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3709af97-5b5d-4fe2-9d8f-f2306c70f26d" returned: 0 in 0.320s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-3709af97-5b5d-4fe2-9d8f-f2306c70f26d" released by "delete_volume" :: held 0.953s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created reservations ['25dc13c3-3e07-47ac-8199-0020df9a5d15', '46653a73-b1c4-4609-9825-699f34f59e28', 'dc1ae0f1-d387-4423-bca0-59e1cffc037f', '7a0a0e48-7f82-4955-8504-78c6438eca69'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:41 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab 1073741824" returned: 0 in 0.614s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:41 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab Sep 25 18:12:41 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:41 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:41 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:41 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" returned: 0 in 0.760s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53ffb116-a1da-4196-bb48-e935e1ba07e0_m3d9xlqldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:41 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 1G Sep 25 18:12:41 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:41 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab" returned: 0 in 0.303s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.524s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249636040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:39Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating volume bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:41 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Deleted volume successfully. Sep 25 18:12:41 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af 1073741824 Sep 25 18:12:41 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75a9bc0-2f50-4a6b-a7de-2434138366ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f9eb95-a7b7-41e2-a38a-e6a8cb6ea26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab (99759151-5ab5-42c3-bdbc-a4fe0e1ebeab): created successfully Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f9eb95-a7b7-41e2-a38a-e6a8cb6ea26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (53ee2ddc-405e-4938-9cbd-191e26247f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-201a3476-87b3-4d69-aa16-d91fdd7c9945 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-3709af97-5b5d-4fe2-9d8f-f2306c70f26d-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-efa91f83-3a83-4405-aff0-3c8ce809236f tempest-CreateVolumesFromSnapshotTest-96776337 None] Created volume successfully. Sep 25 18:12:41 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 1G" returned: 0 in 0.396s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Downloaded image 53ffb116-a1da-4196-bb48-e935e1ba07e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/53ffb116-a1da-4196-bb48-e935e1ba07e0', 'metadata': {}}])) to volume 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Temporary image 53ffb116-a1da-4196-bb48-e935e1ba07e0 for user 50f2fbd4871a4c17b98cfc074eb08365 is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Marking volume 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Copying metadata from image 53ffb116-a1da-4196-bb48-e935e1ba07e0 to 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Creating volume glance metadata for volume 2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 backed by image 53ffb116-a1da-4196-bb48-e935e1ba07e0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0d5f1cdc94bb846b06a1fa65a781e352', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff232cf8-7180-4bc7-8b95-a98e48b2fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12', 'volume_size': 1, 'image_id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53ffb116-a1da-4196-bb48-e935e1ba07e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d5f1cdc94bb846b06a1fa65a781e352', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8053020a9d14491da8ad3cfd6fa6a28b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5861ecd6eead38ae65a023ec839717ae483cd456443a7fd620cb6ebdb85b163c61a0bffd894ed50ed9cb3ac48ef6fe92480063fece06283102a8b4e7ceaaf722', 'id': '53ffb116-a1da-4196-bb48-e935e1ba07e0', 'created_at': datetime.datetime(2026, 9, 25, 16, 12, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 12, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53ffb116-a1da-4196-bb48-e935e1ba07e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4227f9-16bf-4305-9959-f50bf5f307cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Volume volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 (2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12): created successfully Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4227f9-16bf-4305-9959-f50bf5f307cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:41 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Flow 'volume_create_manager' (557ee4d4-f8d4-486f-b379-fb95fe72ca82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d76091d6-e341-4c9d-8d4a-202ed7b3eb84 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Created volume successfully. Sep 25 18:12:42 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af 1073741824" returned: 0 in 0.531s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:42 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af Sep 25 18:12:42 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-d0f409a9-bc52-42c9-adde-a0de26fbf81e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-d0f409a9-bc52-42c9-adde-a0de26fbf81e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-quobyte-d0f409a9-bc52-42c9-adde-a0de26fbf81e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-d0f409a9-bc52-42c9-adde-a0de26fbf81e" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:42 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fd339d-4768-4de0-83ef-dfb3280cd0a1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.677s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1933945739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e785299d-b2c5-41bd-ab06-4f9b3ce07c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f672a6a468884b79bee6935a3fd251eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:40Z,use_quota=True,user_id='34cc18bde1ac439d9dd75c687c7b77d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Creating volume e785299d-b2c5-41bd-ab06-4f9b3ce07c3c {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:42 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:42 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c 1073741824 Sep 25 18:12:42 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af10f8d-1e23-42d1-bdaa-00faab3895d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2a57b0-1d2e-42a0-9009-464c73430efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:42 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af (bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af): created successfully Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2a57b0-1d2e-42a0-9009-464c73430efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (9fbb79fd-2caf-474e-b9cf-3b01fda92851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:42 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63686127-9594-4ee0-87bf-ea980bff7a29 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created volume successfully. Sep 25 18:12:42 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e Sep 25 18:12:42 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:42 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e" returned: 0 in 0.456s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:42 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e Sep 25 18:12:42 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:43 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c 1073741824" returned: 0 in 0.538s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:43 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c Sep 25 18:12:43 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Acquiring lock "cinder-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "cinder-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Acquiring lock "cinder-quobyte-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "cinder-quobyte-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62ed931-41a8-485d-a7aa-414de6555641]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:43 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d0f409a9-bc52-42c9-adde-a0de26fbf81e" returned: 0 in 0.300s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-d0f409a9-bc52-42c9-adde-a0de26fbf81e" released by "delete_volume" :: held 0.835s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created reservations ['3aaa6ed8-d75d-47c5-bec6-381a277acbc7', '5c75cbd1-0710-42df-8e7f-2bba28098738', '7bdb039e-63e5-4039-b526-3a4db388f744', '9795b1a9-c768-4b94-8891-c1e6cb97db1c'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:43 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f57792d-8867-47f4-aca9-2098ab44eb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c23e76c-3693-4020-9fce-821d62fced27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:43 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 Sep 25 18:12:43 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:43 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Volume volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c (e785299d-b2c5-41bd-ab06-4f9b3ce07c3c): created successfully Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c23e76c-3693-4020-9fce-821d62fced27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Flow 'volume_create_manager' (12547ab4-4c05-430d-883f-6342729026cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-11380de2-04f3-4d2f-bd94-2501fed165c5 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created volume successfully. Sep 25 18:12:43 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:43 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-quobyte-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[16beac36-6172-4c81-b086-2e815baaccf3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:43 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" returned: 0 in 0.500s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:43 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12 Sep 25 18:12:43 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:43 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.316s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:43 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Deleted volume successfully. Sep 25 18:12:43 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-28bb1e4f-cc45-480a-bc08-f175769d05a1 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-d0f409a9-bc52-42c9-adde-a0de26fbf81e-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:43 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 Sep 25 18:12:43 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:44 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" returned: 0 in 0.337s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "cinder-quobyte-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12" released by "delete_volume" :: held 0.888s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:44 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8" returned: 0 in 0.457s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:44 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8 Sep 25 18:12:44 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Created reservations ['bcbc23f6-4ea3-4f0a-ade9-736d14d3bae1', '4c6c1ab3-0bd9-40af-ae2e-fdd5657a1675', '5ce5a80b-c4a2-453f-8832-b0c1060dcf56', 'e74ccc9f-9189-4c97-b6ec-53da7977457d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f64a3c9-3b18-4cc8-86b2-cfb8915e25d6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:44 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c Sep 25 18:12:44 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:44 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:44 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:44 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8" released by "delete_volume" :: held 0.840s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created reservations ['8406a491-db2b-4227-b17a-f46f4c48ba97', '487c5668-8e7a-4c8f-8de7-5fa1e9fe6842', '04b1939c-0ee2-467f-b8a0-a89ccd6c1261', 'cabeb29f-8bc0-4db5-bdf7-01afcbf4aaba'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:44 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:44 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:44 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.327s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:44 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Deleted volume successfully. Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a7c11c01-6008-47fb-96be-9712e3f4c5a8 tempest-VolumeAndVolumeTypeFromImageTest-2071496771 None] Lock "cinder-2fbdfd29-4c3a-4570-a2fe-d6238a9c8e12-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:44 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-5963cfea-a333-450a-b3aa-3805ff569b79-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c" returned: 0 in 0.497s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:44 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-5963cfea-a333-450a-b3aa-3805ff569b79-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:44 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-quobyte-5963cfea-a333-450a-b3aa-3805ff569b79" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-5963cfea-a333-450a-b3aa-3805ff569b79" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb39a7-eb06-4843-ac71-36182ea92da7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:45 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.349s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:45 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Deleted volume successfully. Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ed61d38-77be-474b-b2fa-9c70e91dba97 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-36d8d23e-fcd4-4dee-b9fc-24ddd3aa14d8-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:45 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 Sep 25 18:12:45 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:45 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c" released by "delete_volume" :: held 0.901s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['454c681a-427e-492f-b7dd-2a4b562872dc', '9877c7f3-88a8-43c9-8749-a2e90a40c06d', '7866e12b-d814-4f26-b9fc-81b07ef9da1b', '46e90120-689e-474b-88b3-2995e0f6dfc4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:45 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:45 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:45 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79" returned: 0 in 0.468s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:45 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79 Sep 25 18:12:45 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:45 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:45 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleted volume successfully. Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-af043153-e124-4fd4-9ecc-0969b5ed2887 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-e785299d-b2c5-41bd-ab06-4f9b3ce07c3c-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:45 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5963cfea-a333-450a-b3aa-3805ff569b79" returned: 0 in 0.317s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-5963cfea-a333-450a-b3aa-3805ff569b79" released by "delete_volume" :: held 0.844s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created reservations ['41467977-ed70-45cd-97c1-d9f2281a5183', 'a5559c3b-18cf-499e-9d37-ffe855eeb5d6', '03224673-e601-4a68-a844-5bee54844579', 'be5d1f6f-fa72-4d94-9bc1-adb83cc6e3e1'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:45 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:45 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-743a8ae0-6e78-4d0f-82fc-4d7b000a0736-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-743a8ae0-6e78-4d0f-82fc-4d7b000a0736-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "cinder-quobyte-743a8ae0-6e78-4d0f-82fc-4d7b000a0736" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-743a8ae0-6e78-4d0f-82fc-4d7b000a0736" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff04ba11-ffe2-4eba-9eb1-cbec3e875394]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:46 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.395s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:46 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Deleted volume successfully. Sep 25 18:12:46 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 Sep 25 18:12:46 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-c173c903-b185-41e9-9e1e-93b50fabe233 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-5963cfea-a333-450a-b3aa-3805ff569b79-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e5a54-b33a-476d-85d2-b3853c834512]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:46 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736" returned: 0 in 0.494s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:46 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736 Sep 25 18:12:46 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:46 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af Sep 25 18:12:46 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:47 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-743a8ae0-6e78-4d0f-82fc-4d7b000a0736" returned: 0 in 0.394s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:47 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-quobyte-743a8ae0-6e78-4d0f-82fc-4d7b000a0736" released by "delete_volume" :: held 0.951s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af" returned: 0 in 0.506s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:47 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af Sep 25 18:12:47 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Created reservations ['c0d379b9-0193-4122-8297-1af6885bb872', '731b4581-42ad-4fcb-ac36-3150b51af6ba', '3151aafb-9f96-4842-904a-9c68a63d396b', '94aac746-160d-49d5-81e4-8e7cf0ac525b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:47 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:47 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:47 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af" returned: 0 in 0.319s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af" released by "delete_volume" :: held 0.893s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['91e1941c-6c7b-44f1-be96-9427c5210e50', '9cff0a55-00a3-46e5-a855-a4fd307a372f', '27a70a43-6719-4daf-86a2-e043640fa61e', '722366bc-fffc-49e7-96e5-c361f1e29bdc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:47 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:47 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:47 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.545s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Deleted volume successfully. Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d07413-bd00-4891-8361-e98c764129ac]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-21185a23-2c37-4a46-933b-98183d89aa12 tempest-CreateVolumesFromSourceVolumeTest-744262950 None] Lock "cinder-743a8ae0-6e78-4d0f-82fc-4d7b000a0736-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:48 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:48 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab Sep 25 18:12:48 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.378s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleted volume successfully. Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-fb80bccd-f606-4e63-8947-5558686321c9 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-bfa3e104-4dc7-4b60-b6ba-cf080fb4b1af-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:48 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab" returned: 0 in 0.498s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:48 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab Sep 25 18:12:48 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:48 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab" released by "delete_volume" :: held 0.961s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:48 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['4a2fdab6-bb19-4f52-8835-7912efa58a96', 'b6e07b4a-919e-4dae-8e14-cca430e2d874', '5b51e57a-5948-4656-8a9d-4f4cf8c0885e', '1dd64f52-df7c-452a-b3d5-718eb7f82817'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:49 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:49 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:49 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.371s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleted volume successfully. Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-813397d0-fa39-4aff-893c-d406d7efa744 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-99759151-5ab5-42c3-bdbc-a4fe0e1ebeab-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:49 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (21cfa19f-2342-4720-b8fc-e6fab1558c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0923c83-1b3d-4b04-8ee1-c23fb55c0870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0923c83-1b3d-4b04-8ee1-c23fb55c0870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333412333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba319eb4-0a0c-45de-a06c-4c460f0b0d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:50Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca76577c-b68f-436b-8bc9-d353eb94b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca76577c-b68f-436b-8bc9-d353eb94b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6d34f5-b650-4fe8-96ce-f86bb1ccc4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6d34f5-b650-4fe8-96ce-f86bb1ccc4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba319eb4-0a0c-45de-a06c-4c460f0b0d7c', 'volume_name': 'volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb74243-a6fe-4a55-93ec-cf4a177e2203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb74243-a6fe-4a55-93ec-cf4a177e2203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c23813-cdc1-4565-97ac-8da9032db2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Volume ba319eb4-0a0c-45de-a06c-4c460f0b0d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c', 'volume_size': 1} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333412333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba319eb4-0a0c-45de-a06c-4c460f0b0d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:50Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Creating volume ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:50 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-ed4c9f75-41d1-433d-98f4-9e92d460f785-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-ed4c9f75-41d1-433d-98f4-9e92d460f785-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:50 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c 1073741824 Sep 25 18:12:50 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-ed4c9f75-41d1-433d-98f4-9e92d460f785" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-ed4c9f75-41d1-433d-98f4-9e92d460f785" acquired by "delete_volume" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[596b8d6f-1ca4-4a76-9b28-a2dff2974b2e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:50 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 Sep 25 18:12:50 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:50 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c 1073741824" returned: 0 in 0.566s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:50 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785" returned: 0 in 0.450s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:50 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785 Sep 25 18:12:50 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:50 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c Sep 25 18:12:50 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:51 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ed4c9f75-41d1-433d-98f4-9e92d460f785" returned: 0 in 0.301s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-ed4c9f75-41d1-433d-98f4-9e92d460f785" released by "delete_volume" :: held 0.812s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:51 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" returned: 0 in 0.352s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c23813-cdc1-4565-97ac-8da9032db2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cee517-9c89-4f5e-82a4-de612f5140cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:51 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Volume volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c (ba319eb4-0a0c-45de-a06c-4c460f0b0d7c): created successfully Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cee517-9c89-4f5e-82a4-de612f5140cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (21cfa19f-2342-4720-b8fc-e6fab1558c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['df7f1524-6f38-47d0-b681-ff236ff7d9e3', 'bc770d0b-0ec6-47de-a531-1f7045ccfcc0', 'a8583bad-da57-439e-8a11-d3a519aae8d9', '7c5a45dc-7540-4629-9fbf-3e913c80f2c7'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-51cbec65-ec70-4f72-a404-5b09e30aa812 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:51 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:51 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Flow 'volume_create_manager' (979c5cb6-6d8a-42dd-8466-fd03169a847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5031d79e-17a2-4ccb-a3f2-32fb1eff71cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-01367193-7360-4cd3-a34c-1701e2d26d03-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5031d79e-17a2-4ccb-a3f2-32fb1eff71cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-237878364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d627a6d-f442-4581-aec4-e8cae964c0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fad56fa18d48a883e883eec8b9c02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:51Z,use_quota=True,user_id='8299fe670fb64d9b97d86082e78cd461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e41731-95f8-46af-9ce8-ea01b368f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e41731-95f8-46af-9ce8-ea01b368f435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eddb52-887c-49da-8a87-4e9b799d3509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eddb52-887c-49da-8a87-4e9b799d3509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d627a6d-f442-4581-aec4-e8cae964c0e6', 'volume_name': 'volume-2d627a6d-f442-4581-aec4-e8cae964c0e6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1685059-9f5b-49f4-bf66-a104e0493fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1685059-9f5b-49f4-bf66-a104e0493fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f24b65-6572-4cb6-a0ef-bad2759a929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:51 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Volume 2d627a6d-f442-4581-aec4-e8cae964c0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d627a6d-f442-4581-aec4-e8cae964c0e6', 'volume_size': 1} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-237878364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d627a6d-f442-4581-aec4-e8cae964c0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fad56fa18d48a883e883eec8b9c02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:51Z,use_quota=True,user_id='8299fe670fb64d9b97d86082e78cd461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Creating volume 2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:51 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-01367193-7360-4cd3-a34c-1701e2d26d03-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:51 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 1073741824 Sep 25 18:12:51 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-01367193-7360-4cd3-a34c-1701e2d26d03" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-01367193-7360-4cd3-a34c-1701e2d26d03" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[281fbb7d-bcc5-48a5-a3c5-577980f46ff1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:51 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.360s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleted volume successfully. Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f9634c44-5c98-4781-8e7c-c638d0f6dde7 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-ed4c9f75-41d1-433d-98f4-9e92d460f785-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:51 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 Sep 25 18:12:51 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:51 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 1073741824" returned: 0 in 0.535s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:52 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03" returned: 0 in 0.498s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:52 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 Sep 25 18:12:52 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:52 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03 Sep 25 18:12:52 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:52 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-01367193-7360-4cd3-a34c-1701e2d26d03" returned: 0 in 0.295s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-01367193-7360-4cd3-a34c-1701e2d26d03" released by "delete_volume" :: held 0.848s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:52 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6" returned: 0 in 0.356s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f24b65-6572-4cb6-a0ef-bad2759a929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d627a6d-f442-4581-aec4-e8cae964c0e6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb301ee-a389-4289-833e-f56088a69817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Volume volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 (2d627a6d-f442-4581-aec4-e8cae964c0e6): created successfully Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb301ee-a389-4289-833e-f56088a69817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Flow 'volume_create_manager' (979c5cb6-6d8a-42dd-8466-fd03169a847e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4b6efdde-94dd-4a22-b954-4a39ed15cedc tempest-VolumeDependencyTests-191186798 None] Created volume successfully. Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['b36b7ebd-65c1-4a88-8397-4d8553e63156', 'd334994d-c7ba-4e4b-85aa-64997b8d1bb1', '0ec53a92-e153-4e04-8815-898c0c6ef4cb', 'e283ee91-2826-4f72-83b4-fbf0378e66e3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:52 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:52 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 472dec39-68cb-445f-85ef-64c0123750ee of volume ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5f1e4-4fb2-4206-86df-d5f907f91d50]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:52 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c Sep 25 18:12:52 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:52 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.262s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleted volume successfully. Sep 25 18:12:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1a618627-d97e-425b-a468-8216df866324 tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-01367193-7360-4cd3-a34c-1701e2d26d03-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:53 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:53 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee 1G Sep 25 18:12:53 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:53 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee 1G" returned: 0 in 0.526s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:53 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee Sep 25 18:12:53 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-7ad90464-7164-4a6a-b588-7072ede2436e-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-7ad90464-7164-4a6a-b588-7072ede2436e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-7ad90464-7164-4a6a-b588-7072ede2436e" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-7ad90464-7164-4a6a-b588-7072ede2436e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleting offline snapshot 7ad90464-7164-4a6a-b588-7072ede2436e of volume 1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] snapshot_file for this snap is: volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f367c5f-70cf-442d-9c4e-11a1b5212f79]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:53 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e Sep 25 18:12:53 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:53 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee" returned: 0 in 0.384s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:53 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee is being set with open permissions: ugo+rw Sep 25 18:12:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:54 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee Sep 25 18:12:54 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:54 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3e933c-8e5b-42a3-ac30-03f24994fa79]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:54 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee" returned: 0 in 0.284s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:54 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info Sep 25 18:12:54 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:54 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff Sep 25 18:12:54 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:54 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info" returned: 0 in 0.281s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:54 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info is being set with open permissions: ugo+rw Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:54 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info Sep 25 18:12:54 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:54 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" returned: 0 in 0.430s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:54 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e Sep 25 18:12:54 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:54 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.info" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.261s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Creating offline snapshot aff8ecfd-8718-43a9-afd6-deba20cbcb26 of volume 2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:12:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e5bc7966-afdf-4e30-be44-f1e659d088ef tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc04bc0-dc7b-44e7-9935-a3fb0eebca82]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:55 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e" returned: 0 in 0.422s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:55 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 Sep 25 18:12:55 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:55 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e Sep 25 18:12:55 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:55 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff.7ad90464-7164-4a6a-b588-7072ede2436e" returned: 0 in 0.293s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:55 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6" returned: 0 in 0.457s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-7ad90464-7164-4a6a-b588-7072ede2436e" released by "_delete_snapshot" :: held 1.695s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" released by "delete_snapshot" :: held 1.723s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:55 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 1G Sep 25 18:12:55 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['680fb869-fc0f-41ae-acff-77800cc2edc2', '522d5133-0619-4fa5-b7f4-759d59b22f1b', '8650b332-a4e5-431a-a11d-623c8b14092b', '2b3994b4-24c3-41b6-960d-c753a4c186a1'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Delete snapshot completed successfully. Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4f562c1d-b7b3-4b2d-85d1-417bf522a5fb tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-7ad90464-7164-4a6a-b588-7072ede2436e-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-472dec39-68cb-445f-85ef-64c0123750ee-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Lock "cinder-472dec39-68cb-445f-85ef-64c0123750ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-472dec39-68cb-445f-85ef-64c0123750ee" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-472dec39-68cb-445f-85ef-64c0123750ee" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 472dec39-68cb-445f-85ef-64c0123750ee of volume ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a803ff64-5e8c-4049-9ffd-d9807da14af8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-1f8162e1-c119-47e7-9bcf-06c10e1d70ff-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-1f8162e1-c119-47e7-9bcf-06c10e1d70ff-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:55 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:55 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "cinder-quobyte-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:56 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee Sep 25 18:12:56 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 1G" returned: 0 in 0.649s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edd70ba-ba43-42cb-baef-5d57a841a85e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:56 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 Sep 25 18:12:56 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff Sep 25 18:12:56 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.411s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:12:56 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 is being set with open permissions: ugo+rw Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:56 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee" returned: 0 in 0.611s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:12:56 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 Sep 25 18:12:56 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[908581e8-c491-4514-b9fe-f730cec2e8cb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:56 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" returned: 0 in 0.459s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:56 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff Sep 25 18:12:56 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c Sep 25 18:12:56 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26" returned: 0 in 0.323s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:56 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" returned: 0 in 0.317s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info Sep 25 18:12:56 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-quobyte-1f8162e1-c119-47e7-9bcf-06c10e1d70ff" released by "delete_volume" :: held 0.870s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Created reservations ['35e74d51-d282-4910-af14-7c5d342c72d3', 'bc9056c4-f13d-4c1e-adde-73db5fa9ff55', '9ada7400-ee17-4cd5-bc2c-0a566b922b2f', '1b752fc4-b865-4308-8eeb-c12d5ab8f3ee'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:56 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:57 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee Sep 25 18:12:57 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:57 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:12:57 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:57 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:57 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info is being set with open permissions: ugo+rw Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:57 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info Sep 25 18:12:57 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:57 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:57 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee" returned: 0 in 0.478s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.377s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:12:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Deleted volume successfully. Sep 25 18:12:57 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee Sep 25 18:12:57 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:57 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.info" returned: 0 in 0.332s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.628s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f0392a66-1676-4af9-a436-60771d913abc tempest-CreateVolumesFromSnapshotTest-96776337 None] Lock "cinder-1f8162e1-c119-47e7-9bcf-06c10e1d70ff-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1f00c4ac-fd2f-465a-a418-43e29a2969e6 tempest-VolumeDependencyTests-191186798 None] Create snapshot completed successfully Sep 25 18:12:57 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c.472dec39-68cb-445f-85ef-64c0123750ee" returned: 0 in 0.300s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-472dec39-68cb-445f-85ef-64c0123750ee" released by "_delete_snapshot" :: held 1.990s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" released by "delete_snapshot" :: held 2.029s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Created reservations ['9de714f0-ce75-44d9-8e13-415d3ade04b3', 'a3b57f11-0ba6-48b0-8611-50fbdad50cdf', '3557352e-e215-4499-a77a-413cd7695bf3', 'a885a205-c9b4-4a62-8ccc-f12948924e5c'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:12:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:12:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5dbf5788-7a4a-41b9-ac3a-5065198577d8 tempest-ProjectMemberTests-279522478 None] Lock "cinder-472dec39-68cb-445f-85ef-64c0123750ee-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Flow 'volume_create_manager' (b538ac82-a83c-4fd1-a861-60082d7b3054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706f3441-343f-4867-b400-ed35cfc94d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706f3441-343f-4867-b400-ed35cfc94d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1621883220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e55cea1-1adc-4e98-80d1-f33764b31298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fad56fa18d48a883e883eec8b9c02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aff8ecfd-8718-43a9-afd6-deba20cbcb26,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:12:58Z,use_quota=True,user_id='8299fe670fb64d9b97d86082e78cd461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e77037-7b2b-4150-b3d6-34c8b6d7606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e77037-7b2b-4150-b3d6-34c8b6d7606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b316ec-f7e9-4ec2-a9f4-90a0ed86c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b316ec-f7e9-4ec2-a9f4-90a0ed86c294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e55cea1-1adc-4e98-80d1-f33764b31298', 'volume_name': 'volume-5e55cea1-1adc-4e98-80d1-f33764b31298', 'volume_size': 1, 'snapshot_id': 'aff8ecfd-8718-43a9-afd6-deba20cbcb26'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09c8518-9fc8-49f9-9030-7278ff8d88a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09c8518-9fc8-49f9-9030-7278ff8d88a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ae3512-011e-461a-8749-05f361129c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:12:58 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Volume 5e55cea1-1adc-4e98-80d1-f33764b31298: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e55cea1-1adc-4e98-80d1-f33764b31298', 'volume_size': 1, 'snapshot_id': 'aff8ecfd-8718-43a9-afd6-deba20cbcb26'} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-quobyte-aff8ecfd-8718-43a9-afd6-deba20cbcb26-5e55cea1-1adc-4e98-80d1-f33764b31298" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-aff8ecfd-8718-43a9-afd6-deba20cbcb26-5e55cea1-1adc-4e98-80d1-f33764b31298" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Creating volume 5e55cea1-1adc-4e98-80d1-f33764b31298 from snapshot aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-quobyte-5e55cea1-1adc-4e98-80d1-f33764b31298" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-5e55cea1-1adc-4e98-80d1-f33764b31298" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] snapshot: aff8ecfd-8718-43a9-afd6-deba20cbcb26, volume: 5e55cea1-1adc-4e98-80d1-f33764b31298, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed37ed18-86be-4745-8e87-eab2adb76356]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:58 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 Sep 25 18:12:58 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Lock "cinder-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[422af4dd-1d12-49a8-9a7d-a303773e8230]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:59 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26" returned: 0 in 0.507s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d627a6d-f442-4581-aec4-e8cae964c0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d20a69-4796-45f8-92ed-4b5e0faae7e4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:59 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c Sep 25 18:12:59 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:59 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 Sep 25 18:12:59 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:59 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" returned: 0 in 0.505s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:59 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c Sep 25 18:12:59 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:12:59 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6" returned: 0 in 0.589s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:12:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:12:59 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 Sep 25 18:12:59 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:00 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" returned: 0 in 0.345s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c" released by "delete_volume" :: held 0.937s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Created reservations ['f344944a-83de-4576-8e2e-cc34554cc5b8', '1486a956-bd24-4acd-89d3-33e8544fad40', 'acb5e374-a116-4e34-b063-76fa9fa0cc99', 'a72372ce-6e2a-49f3-b863-381880d5d0eb'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:00 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:00 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:00 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.513s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:13:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-131a01ba-8b86-4964-bded-e2347474b917 tempest-ProjectMemberTests-279522478 None] Lock "cinder-ba319eb4-0a0c-45de-a06c-4c460f0b0d7c-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (01abcc0a-fe8d-48b3-815b-944d42dc7ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df18c3d-d9d4-4f6f-88df-c6225d0bbdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df18c3d-d9d4-4f6f-88df-c6225d0bbdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339088187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e8955c-f7ad-436e-8c1d-924044dca25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:02Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb68dc7-46ca-4464-ad55-761b95c11c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb68dc7-46ca-4464-ad55-761b95c11c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e500ca15-183a-43cd-ab58-102b34a90a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e500ca15-183a-43cd-ab58-102b34a90a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e8955c-f7ad-436e-8c1d-924044dca25b', 'volume_name': 'volume-d6e8955c-f7ad-436e-8c1d-924044dca25b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cdd50e-7d52-4dcb-a3b7-b5ea26fac759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cdd50e-7d52-4dcb-a3b7-b5ea26fac759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f1e3d5-41c8-4d9b-92ea-ae88204b5e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:02 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Volume d6e8955c-f7ad-436e-8c1d-924044dca25b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e8955c-f7ad-436e-8c1d-924044dca25b', 'volume_size': 1} Sep 25 18:13:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:08 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298" returned: 0 in 8.615s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:13:08 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Converted 1024.00 MB image at 118.86 MB/s Sep 25 18:13:08 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 is being set with open permissions: ugo+rw Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:08 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 Sep 25 18:13:08 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Flow 'volume_create_manager' (e2ede14b-128d-4278-bef4-e22fa0f9c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a40f0-1a33-4b8c-8df3-32cac173f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a40f0-1a33-4b8c-8df3-32cac173f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ec9663-300d-44fd-a19b-70121e40c935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56eb7fc8ac9d48558bdbb81bfa232c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:08Z,use_quota=True,user_id='cb9d23468eee492e9e7b2570ec5e8abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846037a2-2959-4f1b-9d8c-07d810a0fe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846037a2-2959-4f1b-9d8c-07d810a0fe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefa3feb-be1e-47b7-a3c8-773607b65426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.image.glance [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Creating Keystone auth plugin from conf {{(pid=86665) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 18:13:08 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298" returned: 0 in 0.297s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-5e55cea1-1adc-4e98-80d1-f33764b31298" released by "_copy_volume_from_snapshot" :: held 10.127s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-aff8ecfd-8718-43a9-afd6-deba20cbcb26-5e55cea1-1adc-4e98-80d1-f33764b31298" released by "_create_volume_from_snapshot" :: held 10.210s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.229s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.218s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1339088187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e8955c-f7ad-436e-8c1d-924044dca25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:02Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Creating volume d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:08 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:08 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b 1073741824 Sep 25 18:13:08 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ae3512-011e-461a-8749-05f361129c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e55cea1-1adc-4e98-80d1-f33764b31298', 'volume_size': 1, 'snapshot_id': 'aff8ecfd-8718-43a9-afd6-deba20cbcb26'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ece8b61-59c6-48fd-9824-1fa20e36f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:08 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Volume volume-5e55cea1-1adc-4e98-80d1-f33764b31298 (5e55cea1-1adc-4e98-80d1-f33764b31298): created successfully Sep 25 18:13:08 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ece8b61-59c6-48fd-9824-1fa20e36f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Flow 'volume_create_manager' (b538ac82-a83c-4fd1-a861-60082d7b3054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:09 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ddc4fe2e-8c9f-4e14-8691-665c9d2f9232 tempest-VolumeDependencyTests-191186798 None] Created volume successfully. Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefa3feb-be1e-47b7-a3c8-773607b65426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00ec9663-300d-44fd-a19b-70121e40c935', 'volume_name': 'volume-00ec9663-300d-44fd-a19b-70121e40c935', 'volume_size': 1, 'image_id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b855b49acfc47c84477ea76a8bc941e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56eb7fc8ac9d48558bdbb81bfa232c53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '596d8c5fbcf63619370c46e453db7db407ba2c1dc5d9c1ce01836cb592c6fb901efa5d45e3118e994721b910bd0ab9a340aa2f866fcd6e38da8dfe5f3874b428', 'id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'created_at': datetime.datetime(2026, 9, 25, 16, 13, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0/file', 'properties': {}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942015bd-49f2-49e8-9213-07a1473dfbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942015bd-49f2-49e8-9213-07a1473dfbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a08a6c6-0daa-469c-8fa4-f0a054feb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:09 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Volume 00ec9663-300d-44fd-a19b-70121e40c935: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00ec9663-300d-44fd-a19b-70121e40c935', 'volume_size': 1, 'image_id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b855b49acfc47c84477ea76a8bc941e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56eb7fc8ac9d48558bdbb81bfa232c53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '596d8c5fbcf63619370c46e453db7db407ba2c1dc5d9c1ce01836cb592c6fb901efa5d45e3118e994721b910bd0ab9a340aa2f866fcd6e38da8dfe5f3874b428', 'id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'created_at': datetime.datetime(2026, 9, 25, 16, 13, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0/file', 'properties': {}}, 'image_service': } Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Trying to clone 00ec9663-300d-44fd-a19b-70121e40c935 from image 7cfe4562-ef5a-4268-9710-d96675a1a7a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'metadata': {}}]). {{(pid=86665) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 18:13:09 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Image download 0.00 MB at 0.00 MB/s Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5cba4f-6a86-4e67-b40c-b1a4d2efd704]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:09 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD Sep 25 18:13:09 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:09 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b 1073741824" returned: 0 in 0.680s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:09 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b Sep 25 18:13:09 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-aff8ecfd-8718-43a9-afd6-deba20cbcb26-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-aff8ecfd-8718-43a9-afd6-deba20cbcb26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-quobyte-2d627a6d-f442-4581-aec4-e8cae964c0e6" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-2d627a6d-f442-4581-aec4-e8cae964c0e6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-quobyte-aff8ecfd-8718-43a9-afd6-deba20cbcb26" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:09 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-aff8ecfd-8718-43a9-afd6-deba20cbcb26" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Deleting offline snapshot aff8ecfd-8718-43a9-afd6-deba20cbcb26 of volume 2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] snapshot_file for this snap is: volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed5ad14-4511-4e6d-ae21-0e6dd5c05c2a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:09 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD Sep 25 18:13:09 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:10 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b" returned: 0 in 0.396s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f1e3d5-41c8-4d9b-92ea-ae88204b5e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e8955c-f7ad-436e-8c1d-924044dca25b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a56ff6-50ec-4fa2-8fb0-5cf375e9f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:10 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Volume volume-d6e8955c-f7ad-436e-8c1d-924044dca25b (d6e8955c-f7ad-436e-8c1d-924044dca25b): created successfully Sep 25 18:13:10 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 Sep 25 18:13:10 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a56ff6-50ec-4fa2-8fb0-5cf375e9f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (01abcc0a-fe8d-48b3-815b-944d42dc7ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-061f2918-95ec-4762-a347-c02cb6ba6362 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:13:10 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Temporary image 7cfe4562-ef5a-4268-9710-d96675a1a7a0 is fetched for user cb9d23468eee492e9e7b2570ec5e8abc. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b1b2e2-9d79-4b2d-be2a-e214ed524de5]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:10 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26" returned: 0 in 0.579s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d627a6d-f442-4581-aec4-e8cae964c0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b854a-2f1b-431e-ae7c-a9e90bf570ce]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:10 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD Sep 25 18:13:10 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:10 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 Sep 25 18:13:10 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:10 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:10 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD Sep 25 18:13:10 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:11 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6" returned: 0 in 0.612s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:11 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 Sep 25 18:13:11 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:11 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ec9663-300d-44fd-a19b-70121e40c935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56eb7fc8ac9d48558bdbb81bfa232c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:08Z,use_quota=True,user_id='cb9d23468eee492e9e7b2570ec5e8abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Creating volume 00ec9663-300d-44fd-a19b-70121e40c935 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:11 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:11 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 1073741824 Sep 25 18:13:11 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:11 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26" returned: 0 in 0.428s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:11 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26 Sep 25 18:13:11 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:11 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 1073741824" returned: 0 in 0.536s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:11 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 Sep 25 18:13:11 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:11 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6.aff8ecfd-8718-43a9-afd6-deba20cbcb26" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-aff8ecfd-8718-43a9-afd6-deba20cbcb26" released by "_delete_snapshot" :: held 2.121s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-2d627a6d-f442-4581-aec4-e8cae964c0e6" released by "delete_snapshot" :: held 2.168s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Created reservations ['ecbf55b1-10ec-4955-acf6-c56bef257a39', '60b5ae2a-6aac-4c13-9da0-bde73bdf1720', 'f9870675-bdfd-48da-a27d-bbf3cb24bd74', '519c1096-63f9-4f94-8bbb-9b9401c8dfcd'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Delete snapshot completed successfully. Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0195e471-e3c2-4251-8176-7100c2fc0439 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-aff8ecfd-8718-43a9-afd6-deba20cbcb26-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:12 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935" returned: 0 in 0.303s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 5fd99abb-37f5-47ec-84c2-a9065a6d1b69 of volume d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Attempting download of 7cfe4562-ef5a-4268-9710-d96675a1a7a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'metadata': {}}])) to volume 00ec9663-300d-44fd-a19b-70121e40c935. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7416c23-dae5-4512-842f-c71006aca4e7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43cf0f-db01-40cd-a0c1-17308e1df8f6]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:12 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b Sep 25 18:13:12 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:12 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8 Sep 25 18:13:12 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:12 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:12 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b" returned: 0 in 0.461s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:12 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 1G Sep 25 18:13:12 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:12 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8 Sep 25 18:13:12 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8" returned: 1 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cfe4562-ef5a-4268-9710-d96675a1a7a0_xacq5ge8' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da55443-88cf-4278-a79a-d986dc48ac57]: (4, 'raw') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-2d627a6d-f442-4581-aec4-e8cae964c0e6-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-2d627a6d-f442-4581-aec4-e8cae964c0e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-quobyte-2d627a6d-f442-4581-aec4-e8cae964c0e6" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-2d627a6d-f442-4581-aec4-e8cae964c0e6" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c02ab19-099a-4ea6-9544-ec81ce5b44cf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:13 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 1G" returned: 0 in 0.605s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e8955c-f7ad-436e-8c1d-924044dca25b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:13 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD Sep 25 18:13:13 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e8955c-f7ad-436e-8c1d-924044dca25b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 Sep 25 18:13:13 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 Sep 25 18:13:13 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD" returned: 0 in 0.541s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:13 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e8955c-f7ad-436e-8c1d-924044dca25b -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69" returned: 0 in 0.379s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:13 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 is being set with open permissions: ugo+rw Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:13 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 Sep 25 18:13:13 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD Sep 25 18:13:13 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6" returned: 0 in 0.500s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:13 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6 Sep 25 18:13:13 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:13 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69" returned: 0 in 0.305s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=241,cinder:SELECT=175,cinder:INSERT=62,cinder:DELETE=19 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=184,cinder:UPDATE=249,cinder:INSERT=63,cinder:DELETE=25 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:13:13 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] 7cfe4562-ef5a-4268-9710-d96675a1a7a0 was raw, converting to qcow2 {{(pid=86665) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:14 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info Sep 25 18:13:14 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:14 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 Sep 25 18:13:14 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:14 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2d627a6d-f442-4581-aec4-e8cae964c0e6" returned: 0 in 0.360s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-2d627a6d-f442-4581-aec4-e8cae964c0e6" released by "delete_volume" :: held 0.949s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Created reservations ['f0116e69-5d19-46db-86f1-c98592f747a3', 'd667f3b5-5c9a-48a8-bfbd-3d9b9c4a151f', 'b3622506-e556-4eb5-95f7-3b2a41188bf7', '9b642923-57a9-4208-95a1-fe74be0f9dc5'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:14 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info" returned: 0 in 0.359s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:14 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info is being set with open permissions: ugo+rw Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:14 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:14 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:14 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info Sep 25 18:13:14 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-5e55cea1-1adc-4e98-80d1-f33764b31298-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-5e55cea1-1adc-4e98-80d1-f33764b31298-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "cinder-quobyte-5e55cea1-1adc-4e98-80d1-f33764b31298" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-5e55cea1-1adc-4e98-80d1-f33764b31298" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd094690-9a87-4bfc-ae19-89486a93ccdf]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:14 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.380s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Deleted volume successfully. Sep 25 18:13:14 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-4eb87757-f459-41f0-9a6b-33842f6a6d32 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-2d627a6d-f442-4581-aec4-e8cae964c0e6-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:14 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.info" returned: 0 in 0.377s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935" returned: 0 in 0.736s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7cfe4562-ef5a-4268-9710-d96675a1a7a0_ez5f76n9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:13:14 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 18:13:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:14 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 Sep 25 18:13:14 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:14 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 1G Sep 25 18:13:14 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b54eff9c-6225-488e-a852-9c5d3acb1fa7 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:13:15 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298" returned: 0 in 0.496s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:15 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298 Sep 25 18:13:15 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:15 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 1G" returned: 0 in 0.361s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Downloaded image 7cfe4562-ef5a-4268-9710-d96675a1a7a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'metadata': {}}])) to volume 00ec9663-300d-44fd-a19b-70121e40c935 successfully. {{(pid=86665) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Temporary image 7cfe4562-ef5a-4268-9710-d96675a1a7a0 for user cb9d23468eee492e9e7b2570ec5e8abc is deleted. {{(pid=86665) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.volume_utils [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Marking volume 00ec9663-300d-44fd-a19b-70121e40c935 as bootable. {{(pid=86665) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Copying metadata from image 7cfe4562-ef5a-4268-9710-d96675a1a7a0 to 00ec9663-300d-44fd-a19b-70121e40c935. {{(pid=86665) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Creating volume glance metadata for volume 00ec9663-300d-44fd-a19b-70121e40c935 backed by image 7cfe4562-ef5a-4268-9710-d96675a1a7a0 with: {'image_id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1b855b49acfc47c84477ea76a8bc941e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86665) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a08a6c6-0daa-469c-8fa4-f0a054feb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ec9663-300d-44fd-a19b-70121e40c935', 'volume_size': 1, 'image_id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b855b49acfc47c84477ea76a8bc941e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56eb7fc8ac9d48558bdbb81bfa232c53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '596d8c5fbcf63619370c46e453db7db407ba2c1dc5d9c1ce01836cb592c6fb901efa5d45e3118e994721b910bd0ab9a340aa2f866fcd6e38da8dfe5f3874b428', 'id': '7cfe4562-ef5a-4268-9710-d96675a1a7a0', 'created_at': datetime.datetime(2026, 9, 25, 16, 13, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cfe4562-ef5a-4268-9710-d96675a1a7a0/file', 'properties': {}}, 'image_service': }' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a209f57-34c5-4f15-b205-e75a8f53c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:15 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Volume volume-00ec9663-300d-44fd-a19b-70121e40c935 (00ec9663-300d-44fd-a19b-70121e40c935): created successfully Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a209f57-34c5-4f15-b205-e75a8f53c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Flow 'volume_create_manager' (e2ede14b-128d-4278-bef4-e22fa0f9c473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-69108ce4-08dd-4b66-b5f2-f424e6a069f6 tempest-VolumeImageDependencyTests-750311334 None] Created volume successfully. Sep 25 18:13:15 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5e55cea1-1adc-4e98-80d1-f33764b31298" returned: 0 in 0.316s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-quobyte-5e55cea1-1adc-4e98-80d1-f33764b31298" released by "delete_volume" :: held 0.861s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Created reservations ['9cd27d81-e0bf-40f8-b96c-d5b7a5c7f14d', '67f7e0d2-df1f-40d9-9971-9ff3aaecadee', 'b0c68a5e-9182-420e-ab4c-79569dc33098', '971ceca4-7a11-4011-975b-e74cb19a1bc6'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:15 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:15 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-5fd99abb-37f5-47ec-84c2-a9065a6d1b69-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Lock "cinder-5fd99abb-37f5-47ec-84c2-a9065a6d1b69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-d6e8955c-f7ad-436e-8c1d-924044dca25b" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-d6e8955c-f7ad-436e-8c1d-924044dca25b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-5fd99abb-37f5-47ec-84c2-a9065a6d1b69" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-5fd99abb-37f5-47ec-84c2-a9065a6d1b69" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 5fd99abb-37f5-47ec-84c2-a9065a6d1b69 of volume d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:15 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.318s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:15 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Deleted volume successfully. Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aac248-96be-4e46-a6e7-f255ecb85dd9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:15 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5fae5414-d426-41d3-9919-aeeecb0c4019 tempest-VolumeDependencyTests-191186798 None] Lock "cinder-5e55cea1-1adc-4e98-80d1-f33764b31298-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:15 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 Sep 25 18:13:15 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Acquiring lock "cinder-00ec9663-300d-44fd-a19b-70121e40c935-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Lock "cinder-00ec9663-300d-44fd-a19b-70121e40c935-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Acquiring lock "cinder-quobyte-00ec9663-300d-44fd-a19b-70121e40c935" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Lock "cinder-quobyte-00ec9663-300d-44fd-a19b-70121e40c935" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:16 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69" returned: 0 in 0.469s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e8955c-f7ad-436e-8c1d-924044dca25b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[97055f27-10a1-4872-a85e-fc16d3b87402]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5704f8a2-3526-4a52-8013-9bada66b0acb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:16 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 Sep 25 18:13:16 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:16 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b Sep 25 18:13:16 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:16 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935" returned: 0 in 0.550s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:16 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935 Sep 25 18:13:16 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:16 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b" returned: 0 in 0.574s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:16 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 Sep 25 18:13:16 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:17 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-00ec9663-300d-44fd-a19b-70121e40c935" returned: 0 in 0.319s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Lock "cinder-quobyte-00ec9663-300d-44fd-a19b-70121e40c935" released by "delete_volume" :: held 0.956s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Created reservations ['f0951e7e-7b23-4d3d-99b6-82baee8545bc', '39ff016d-9662-49b3-997e-4f13aee2760e', 'e9cfe82c-0ddc-461e-ae25-da7a3fdff74a', 'c451371e-9a03-4fe4-9743-d732e56163f3'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:17 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69" returned: 0 in 0.525s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:17 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:17 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:17 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69 Sep 25 18:13:17 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:17 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.365s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:17 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b.5fd99abb-37f5-47ec-84c2-a9065a6d1b69" returned: 0 in 0.360s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Deleted volume successfully. Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-5fd99abb-37f5-47ec-84c2-a9065a6d1b69" released by "_delete_snapshot" :: held 2.121s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-811de1df-0cd2-4977-b2d1-a5f3d24ef919 tempest-VolumeImageDependencyTests-750311334 None] Lock "cinder-00ec9663-300d-44fd-a19b-70121e40c935-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-d6e8955c-f7ad-436e-8c1d-924044dca25b" released by "delete_snapshot" :: held 2.157s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:17 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Created reservations ['8cd4c5ee-7e37-496a-9fed-cef3d20e84cc', 'b7ad6a2d-c628-465f-affa-4ceba56ead07', 'eab042b9-404c-4d79-ab46-ca59ebec5b31', '6a3df475-a6a1-46b2-b7c2-2035a8602a28'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:13:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-bae4fbd6-4120-4f66-8848-16902c212a49 tempest-ProjectMemberTests-279522478 None] Lock "cinder-5fd99abb-37f5-47ec-84c2-a9065a6d1b69-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-d6e8955c-f7ad-436e-8c1d-924044dca25b-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Lock "cinder-d6e8955c-f7ad-436e-8c1d-924044dca25b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-d6e8955c-f7ad-436e-8c1d-924044dca25b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-d6e8955c-f7ad-436e-8c1d-924044dca25b" acquired by "delete_volume" :: waited 0.036s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b930541-1f01-4e63-b02f-3cbba9b21d18]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:19 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b Sep 25 18:13:19 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Flow 'volume_create_manager' (b6f00ab4-f9f3-47d1-babd-ab8f021f09e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f635737-92fd-490e-8d0e-74cea06e5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f635737-92fd-490e-8d0e-74cea06e5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619a03d3-4e52-49a6-9d2c-eb626c37164b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d8c583c9fb4e3082d200c5ae0b3068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:20Z,use_quota=True,user_id='81b9038725ed435b8aeabb4f750a31fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a48027-67ff-4752-8f1a-8612f43b11a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a48027-67ff-4752-8f1a-8612f43b11a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7bb14b-3919-4bd5-ac0c-b519dce42c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7bb14b-3919-4bd5-ac0c-b519dce42c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619a03d3-4e52-49a6-9d2c-eb626c37164b', 'volume_name': 'volume-619a03d3-4e52-49a6-9d2c-eb626c37164b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a05b800-28fc-42e9-abf1-cb965645881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a05b800-28fc-42e9-abf1-cb965645881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3647117-e7da-4979-b5a0-28273449027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Volume 619a03d3-4e52-49a6-9d2c-eb626c37164b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619a03d3-4e52-49a6-9d2c-eb626c37164b', 'volume_size': 1} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619a03d3-4e52-49a6-9d2c-eb626c37164b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d8c583c9fb4e3082d200c5ae0b3068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:20Z,use_quota=True,user_id='81b9038725ed435b8aeabb4f750a31fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Creating volume 619a03d3-4e52-49a6-9d2c-eb626c37164b {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:19 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:19 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b 1073741824 Sep 25 18:13:19 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:19 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b" returned: 0 in 0.569s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:20 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b Sep 25 18:13:20 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:20 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-d6e8955c-f7ad-436e-8c1d-924044dca25b" returned: 0 in 0.404s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-d6e8955c-f7ad-436e-8c1d-924044dca25b" released by "delete_volume" :: held 1.107s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Created reservations ['02aa582b-4498-4542-83da-ade4802a79b8', '78bcfb7a-c528-4df9-bcd8-8a3d77d7300c', '3d9ac358-9067-4bd6-a3b5-5c97118b4607', '4434a309-7f7f-418b-a6f3-61e1bc7b2325'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:20 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b 1073741824" returned: 0 in 0.662s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:20 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b Sep 25 18:13:20 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:20 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:20 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:20 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b" returned: 0 in 0.346s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:20 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.313s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3647117-e7da-4979-b5a0-28273449027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619a03d3-4e52-49a6-9d2c-eb626c37164b', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61044f1-3687-4f1a-9f06-3ec19fbe3978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:13:20 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Volume volume-619a03d3-4e52-49a6-9d2c-eb626c37164b (619a03d3-4e52-49a6-9d2c-eb626c37164b): created successfully Sep 25 18:13:20 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61044f1-3687-4f1a-9f06-3ec19fbe3978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Flow 'volume_create_manager' (b6f00ab4-f9f3-47d1-babd-ab8f021f09e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-500b6bd9-3982-462b-90bd-9edd301be086 tempest-CinderUnicodeTest-861550481 None] Created volume successfully. Sep 25 18:13:21 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-120724a0-b937-4db6-b9f0-5d6aa93bb892 tempest-ProjectMemberTests-279522478 None] Lock "cinder-d6e8955c-f7ad-436e-8c1d-924044dca25b-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (29c2b31c-14c3-426f-92b7-d3b2c3173900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6b5bdd-3b33-45cd-bf57-49427f39b37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6b5bdd-3b33-45cd-bf57-49427f39b37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-431991573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7e364e-d4b8-42b9-8667-d416909c9a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:22Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6f643c-3307-4a1a-8b3d-cfe161004da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6f643c-3307-4a1a-8b3d-cfe161004da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1cee22-da35-46db-a5a4-59fd035fa081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1cee22-da35-46db-a5a4-59fd035fa081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7e364e-d4b8-42b9-8667-d416909c9a29', 'volume_name': 'volume-3f7e364e-d4b8-42b9-8667-d416909c9a29', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c1ef3c-dd54-4442-bdca-91599d957c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c1ef3c-dd54-4442-bdca-91599d957c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a610876d-cb81-4b87-a716-314a9b14cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Volume 3f7e364e-d4b8-42b9-8667-d416909c9a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7e364e-d4b8-42b9-8667-d416909c9a29', 'volume_size': 1} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-431991573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7e364e-d4b8-42b9-8667-d416909c9a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:22Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Creating volume 3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:22 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:22 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 1073741824 Sep 25 18:13:22 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Flow 'volume_create_manager' (2c4e9a1e-25ae-48dc-a455-1de0bc0ee696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9350a28-8eb6-433f-9cad-50b062f9ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9350a28-8eb6-433f-9cad-50b062f9ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-252947119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7e5e1f-78d8-4327-91d5-371c43ca3a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d8c583c9fb4e3082d200c5ae0b3068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:22Z,use_quota=True,user_id='81b9038725ed435b8aeabb4f750a31fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f439fcc-37c3-4fa3-96a4-2b156d27e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f439fcc-37c3-4fa3-96a4-2b156d27e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed25701d-b6b4-48fe-8d3d-23cfdb04c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed25701d-b6b4-48fe-8d3d-23cfdb04c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7e5e1f-78d8-4327-91d5-371c43ca3a22', 'volume_name': 'volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e518f9d9-7c80-4c07-9623-fe237a375dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e518f9d9-7c80-4c07-9623-fe237a375dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367f464b-5667-4b5e-b137-0c6b426313ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:22 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Volume 4b7e5e1f-78d8-4327-91d5-371c43ca3a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22', 'volume_size': 1} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:22 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 1073741824" returned: 0 in 0.609s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:22 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 Sep 25 18:13:22 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:23 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-252947119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7e5e1f-78d8-4327-91d5-371c43ca3a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d8c583c9fb4e3082d200c5ae0b3068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:22Z,use_quota=True,user_id='81b9038725ed435b8aeabb4f750a31fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Creating volume 4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:23 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a610876d-cb81-4b87-a716-314a9b14cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7e364e-d4b8-42b9-8667-d416909c9a29', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:23 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 1073741824 Sep 25 18:13:23 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceecd629-7c16-4221-bfef-11ac52c2c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:23 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Volume volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 (3f7e364e-d4b8-42b9-8667-d416909c9a29): created successfully Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceecd629-7c16-4221-bfef-11ac52c2c98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (29c2b31c-14c3-426f-92b7-d3b2c3173900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:23 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6fb821c8-81d8-4ae3-8d0a-6d677398cafc tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:13:23 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 1073741824" returned: 0 in 0.670s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:23 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 Sep 25 18:13:23 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:24 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" returned: 0 in 0.352s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367f464b-5667-4b5e-b137-0c6b426313ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ce6efc-0af4-4add-a573-83f94c809a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:24 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Volume volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 (4b7e5e1f-78d8-4327-91d5-371c43ca3a22): created successfully Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ce6efc-0af4-4add-a573-83f94c809a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Flow 'volume_create_manager' (2c4e9a1e-25ae-48dc-a455-1de0bc0ee696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-63b0e521-9e2f-41aa-913c-e66daf2109d8 tempest-CinderUnicodeTest-861550481 None] Created volume successfully. Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 2b7af8cc-9909-4fa5-b4f5-2866802ae512 of volume 3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f93571-8fad-474d-8c2a-adfc1c5b0adc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:24 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 Sep 25 18:13:24 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:24 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29" returned: 0 in 0.452s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:24 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 1G Sep 25 18:13:24 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:25 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 1G" returned: 0 in 0.456s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:25 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 Sep 25 18:13:25 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Flow 'volume_create_manager' (f21723b0-5002-432e-bf81-b92401949e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e023c4b6-6968-4a8c-a82a-1082aa6cbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e023c4b6-6968-4a8c-a82a-1082aa6cbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-793070204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c89e40-6fea-4b05-90da-0454183d3285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e43b0bcfc1d40deb74111a35372421a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:25Z,use_quota=True,user_id='d8798180ae2c4a9dbc70af0d8fc43b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b177a3bb-ade7-487a-bac4-2df6798b3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b177a3bb-ade7-487a-bac4-2df6798b3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338350c7-f0ad-4590-b023-e90353412daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338350c7-f0ad-4590-b023-e90353412daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c89e40-6fea-4b05-90da-0454183d3285', 'volume_name': 'volume-07c89e40-6fea-4b05-90da-0454183d3285', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5969171-f483-49a6-8922-a0cd8a99bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5969171-f483-49a6-8922-a0cd8a99bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d371721-d0c9-49c2-96a7-8f25722a9bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:25 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Volume 07c89e40-6fea-4b05-90da-0454183d3285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c89e40-6fea-4b05-90da-0454183d3285', 'volume_size': 1} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:25 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512" returned: 0 in 0.338s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:25 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 is being set with open permissions: ugo+rw Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:25 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 Sep 25 18:13:25 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:25 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:25 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info Sep 25 18:13:25 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:26 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:26 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info is being set with open permissions: ugo+rw Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:26 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info Sep 25 18:13:26 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:26 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.info" returned: 0 in 0.253s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.560s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Creating offline snapshot 15038e00-7ab8-4f20-91de-9d09fee9cc64 of volume 4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:26 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-88506920-ebaa-43d2-846a-c04e44b446c8 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6529da7a-e916-4998-b7dd-1adeb0ec68ff]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:26 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 Sep 25 18:13:26 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:26 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" returned: 0 in 0.365s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:26 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 1G Sep 25 18:13:26 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:27 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 1G" returned: 0 in 0.429s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:27 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 Sep 25 18:13:27 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-2b7af8cc-9909-4fa5-b4f5-2866802ae512-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2b7af8cc-9909-4fa5-b4f5-2866802ae512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-3f7e364e-d4b8-42b9-8667-d416909c9a29" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-3f7e364e-d4b8-42b9-8667-d416909c9a29" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-2b7af8cc-9909-4fa5-b4f5-2866802ae512" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2b7af8cc-9909-4fa5-b4f5-2866802ae512" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 2b7af8cc-9909-4fa5-b4f5-2866802ae512 of volume 3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3e59f-967d-403c-bd73-fedf1ec4d853]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:27 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64" returned: 0 in 0.318s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:27 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 is being set with open permissions: ugo+rw Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:27 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 Sep 25 18:13:27 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:27 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 Sep 25 18:13:27 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:27 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64" returned: 0 in 0.293s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:28 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info Sep 25 18:13:28 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:28 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512" returned: 0 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f7e364e-d4b8-42b9-8667-d416909c9a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88f8c3a-61aa-4f20-a4fd-c22a85eefe66]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:28 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 Sep 25 18:13:28 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:28 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info" returned: 0 in 0.257s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:28 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info is being set with open permissions: ugo+rw Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:28 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info Sep 25 18:13:28 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:28 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29" returned: 0 in 0.384s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:28 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 Sep 25 18:13:28 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:28 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.info" returned: 0 in 0.259s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-793070204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c89e40-6fea-4b05-90da-0454183d3285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e43b0bcfc1d40deb74111a35372421a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:25Z,use_quota=True,user_id='d8798180ae2c4a9dbc70af0d8fc43b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Creating volume 07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:28 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:28 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 1073741824 Sep 25 18:13:28 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d3f758e6-7f7e-4561-84b6-bd6631e40d12 tempest-CinderUnicodeTest-861550481 None] Create snapshot completed successfully Sep 25 18:13:28 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512" returned: 0 in 0.331s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:28 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512 Sep 25 18:13:28 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:29 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 1073741824" returned: 0 in 0.502s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:29 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29.2b7af8cc-9909-4fa5-b4f5-2866802ae512" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2b7af8cc-9909-4fa5-b4f5-2866802ae512" released by "_delete_snapshot" :: held 1.514s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-3f7e364e-d4b8-42b9-8667-d416909c9a29" released by "delete_snapshot" :: held 1.553s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-15038e00-7ab8-4f20-91de-9d09fee9cc64-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:29 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 Sep 25 18:13:29 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Lock "cinder-15038e00-7ab8-4f20-91de-9d09fee9cc64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-quobyte-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-quobyte-15038e00-7ab8-4f20-91de-9d09fee9cc64" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-15038e00-7ab8-4f20-91de-9d09fee9cc64" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Deleting offline snapshot 15038e00-7ab8-4f20-91de-9d09fee9cc64 of volume 4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] snapshot_file for this snap is: volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e259f4-b70a-4238-ba1c-5588c36bc884]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Created reservations ['f5148d7d-3d5f-4b45-bc02-69c57df930de', 'fb56533c-b513-4399-a57e-4c6eb996c046', '7f169e0b-fc94-4283-8662-77dbaa9db442', 'b68c7c75-f950-4894-ac1b-a5790b23b632'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-92283e5f-d587-4413-aa72-8f037f8ba5a5 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2b7af8cc-9909-4fa5-b4f5-2866802ae512-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:29 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 Sep 25 18:13:29 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:29 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285" returned: 0 in 0.312s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d371721-d0c9-49c2-96a7-8f25722a9bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c89e40-6fea-4b05-90da-0454183d3285', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef5ee1-ebf7-403d-9d3f-cb649ebe4dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Volume volume-07c89e40-6fea-4b05-90da-0454183d3285 (07c89e40-6fea-4b05-90da-0454183d3285): created successfully Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef5ee1-ebf7-403d-9d3f-cb649ebe4dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Flow 'volume_create_manager' (f21723b0-5002-432e-bf81-b92401949e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c2165ab0-677d-4ad0-89bc-aed92d3b6052 tempest-SnapshotDependencyTests-1993129742 None] Created volume successfully. Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-3f7e364e-d4b8-42b9-8667-d416909c9a29-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:29 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64" returned: 0 in 0.446s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Lock "cinder-3f7e364e-d4b8-42b9-8667-d416909c9a29-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497a868-91a6-4272-bd15-1b1ebbe8a80b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-3f7e364e-d4b8-42b9-8667-d416909c9a29" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-3f7e364e-d4b8-42b9-8667-d416909c9a29" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[200dbf4a-77d9-40fd-9d3e-25dcdc64e275]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:29 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 Sep 25 18:13:29 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:30 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 Sep 25 18:13:30 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:30 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" returned: 0 in 0.372s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:30 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 Sep 25 18:13:30 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:30 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:30 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29 Sep 25 18:13:30 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:30 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64" returned: 0 in 0.369s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:30 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-3f7e364e-d4b8-42b9-8667-d416909c9a29" returned: 0 in 0.273s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:30 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64 Sep 25 18:13:30 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-3f7e364e-d4b8-42b9-8667-d416909c9a29" released by "delete_volume" :: held 0.709s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Created reservations ['e5af2694-2274-4c38-8a7e-fef7c5f0a031', 'e1456698-870c-43ca-a964-0acdc60250bb', '22f96c68-2b62-4696-81f5-eb08bb5ddba0', '6d925825-8e19-4763-85d4-f530a2d64fe4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:30 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:30 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:30 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22.15038e00-7ab8-4f20-91de-9d09fee9cc64" returned: 0 in 0.260s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-15038e00-7ab8-4f20-91de-9d09fee9cc64" released by "_delete_snapshot" :: held 1.658s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" released by "delete_snapshot" :: held 1.700s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Creating offline snapshot ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 of volume 07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab891ef1-c096-4853-ac6f-61e302bdd4c4]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Created reservations ['89d4b534-ba17-4899-82fd-5f3ec0204050', 'ebbfc267-ee92-4466-9591-9e5d1b2b5f9e', '2d31e371-8682-4846-b90d-c7acf1bf0297', '6f1898d4-59e4-4810-abfd-03f22a819421'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:31 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.335s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-149c78bc-dfbb-43b3-a3dc-fac38e54a016 tempest-ProjectMemberTests-279522478 None] Lock "cinder-3f7e364e-d4b8-42b9-8667-d416909c9a29-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Delete snapshot completed successfully. Sep 25 18:13:31 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 Sep 25 18:13:31 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3ecbdd99-78dc-4b3a-807c-030d537699cd tempest-CinderUnicodeTest-861550481 None] Lock "cinder-15038e00-7ab8-4f20-91de-9d09fee9cc64-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-4b7e5e1f-78d8-4327-91d5-371c43ca3a22-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-4b7e5e1f-78d8-4327-91d5-371c43ca3a22-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-quobyte-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:31 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285" returned: 0 in 0.553s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c967df09-60ff-4ea4-b95f-9edddaaf358c]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:31 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 1G Sep 25 18:13:31 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (4be2100b-552e-4f5b-8ab6-bc75556726c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568501d3-6ece-4d87-b161-f602193f7508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568501d3-6ece-4d87-b161-f602193f7508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024957420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70e6583-5fdd-46a2-8b44-6638bd614147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:31Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d9342f-439e-45bc-8812-4e2b2696fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d9342f-439e-45bc-8812-4e2b2696fb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c8333c-e42e-48e1-a082-9ee4f54cc899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c8333c-e42e-48e1-a082-9ee4f54cc899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70e6583-5fdd-46a2-8b44-6638bd614147', 'volume_name': 'volume-a70e6583-5fdd-46a2-8b44-6638bd614147', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64f7f03-c96c-4126-a8a5-df2908d78749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64f7f03-c96c-4126-a8a5-df2908d78749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729d22c6-2c51-44f7-ac86-3fc771667ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:31 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Volume a70e6583-5fdd-46a2-8b44-6638bd614147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70e6583-5fdd-46a2-8b44-6638bd614147', 'volume_size': 1} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:31 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 Sep 25 18:13:31 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:31 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" returned: 0 in 0.415s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:32 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22 Sep 25 18:13:32 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:32 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 1G" returned: 0 in 0.525s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c89e40-6fea-4b05-90da-0454183d3285 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:32 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c89e40-6fea-4b05-90da-0454183d3285 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 Sep 25 18:13:32 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:32 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" returned: 0 in 0.272s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-4b7e5e1f-78d8-4327-91d5-371c43ca3a22" released by "delete_volume" :: held 0.782s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Created reservations ['02590c96-1624-4890-a684-36e792c88b55', '87f89bfc-fc74-4ffb-a9e9-1f90625ffd7f', '81656a58-8c2a-463e-bbaa-1f65e18bb009', '5c4a8b65-19ce-4c48-9c76-94e929e9711f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:32 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c89e40-6fea-4b05-90da-0454183d3285 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" returned: 0 in 0.317s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:32 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 is being set with open permissions: ugo+rw Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:32 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 Sep 25 18:13:32 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:32 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:32 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-619a03d3-4e52-49a6-9d2c-eb626c37164b-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-619a03d3-4e52-49a6-9d2c-eb626c37164b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "cinder-quobyte-619a03d3-4e52-49a6-9d2c-eb626c37164b" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:32 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-619a03d3-4e52-49a6-9d2c-eb626c37164b" acquired by "delete_volume" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" returned: 0 in 0.281s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4818d8-21b8-4e91-a51f-9a20dc93d1ca]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:32 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.290s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Deleted volume successfully. Sep 25 18:13:32 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info Sep 25 18:13:32 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ac7b5b64-d28a-4c00-b8b9-bc975f191ee4 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-4b7e5e1f-78d8-4327-91d5-371c43ca3a22-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:32 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b Sep 25 18:13:32 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:33 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info" returned: 0 in 0.318s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:33 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info is being set with open permissions: ugo+rw Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:33 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info Sep 25 18:13:33 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:33 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b" returned: 0 in 0.444s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:33 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b Sep 25 18:13:33 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:33 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.info" returned: 0 in 0.258s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024957420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70e6583-5fdd-46a2-8b44-6638bd614147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:31Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Creating volume a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:33 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:33 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 1073741824 Sep 25 18:13:33 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:33 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-619a03d3-4e52-49a6-9d2c-eb626c37164b" returned: 0 in 0.270s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2ee2de4f-6b3f-4ed1-a636-23a4a39ddd4d tempest-SnapshotDependencyTests-1993129742 None] Create snapshot completed successfully Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-quobyte-619a03d3-4e52-49a6-9d2c-eb626c37164b" released by "delete_volume" :: held 0.772s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Created reservations ['d621be81-35f6-4cc3-8c65-0e6b8dc4dc1d', '7f479f8f-3b0f-42c0-bfce-f529234b9030', '3898ea1e-2e91-4249-915c-49c74912651f', 'e6f95827-87d5-4e2e-8617-e91b3814afd4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:33 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:33 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:33 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.274s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Deleted volume successfully. Sep 25 18:13:33 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 1073741824" returned: 0 in 0.528s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-49a5d1e6-9ee7-4c3c-8b11-a1c348cae046 tempest-CinderUnicodeTest-861550481 None] Lock "cinder-619a03d3-4e52-49a6-9d2c-eb626c37164b-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:33 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 Sep 25 18:13:33 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:34 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147" returned: 0 in 0.315s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729d22c6-2c51-44f7-ac86-3fc771667ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70e6583-5fdd-46a2-8b44-6638bd614147', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b93501-99a4-4c65-ade4-9d302898fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:34 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Volume volume-a70e6583-5fdd-46a2-8b44-6638bd614147 (a70e6583-5fdd-46a2-8b44-6638bd614147): created successfully Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b93501-99a4-4c65-ade4-9d302898fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (4be2100b-552e-4f5b-8ab6-bc75556726c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-dc568d38-da8f-478a-955d-d4e32feb1292 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 2dcd06fc-4053-4f71-9599-c7063c5088a7 of volume a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:34 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4cc4ca-2a11-4103-a30a-fa2934aa4253]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Flow 'volume_create_manager' (46ee11fd-d1d9-405d-8a31-d6ba732822c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a30fe7-1e08-4511-b44d-dbc6ffdf3a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a30fe7-1e08-4511-b44d-dbc6ffdf3a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb6fae6-d727-4f61-8023-3261c1e94608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e43b0bcfc1d40deb74111a35372421a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:35Z,use_quota=True,user_id='d8798180ae2c4a9dbc70af0d8fc43b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c5b9fe-b157-45a5-bd4d-22f20d459c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c5b9fe-b157-45a5-bd4d-22f20d459c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e54ca-7fad-46a8-8063-27e2a56a6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e54ca-7fad-46a8-8063-27e2a56a6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecb6fae6-d727-4f61-8023-3261c1e94608', 'volume_name': 'volume-ecb6fae6-d727-4f61-8023-3261c1e94608', 'volume_size': 1, 'snapshot_id': 'ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eee3b9-36fb-43f5-8094-1b4919d3b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7eee3b9-36fb-43f5-8094-1b4919d3b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f6ba38-0b8b-478f-85ad-20a6b042dc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:35 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Volume ecb6fae6-d727-4f61-8023-3261c1e94608: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecb6fae6-d727-4f61-8023-3261c1e94608', 'volume_size': 1, 'snapshot_id': 'ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6'} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:35 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 Sep 25 18:13:35 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:35 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147" returned: 0 in 0.500s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:35 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 1G Sep 25 18:13:35 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:35 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 1G" returned: 0 in 0.478s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a70e6583-5fdd-46a2-8b44-6638bd614147 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:36 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a70e6583-5fdd-46a2-8b44-6638bd614147 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 Sep 25 18:13:36 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:36 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a70e6583-5fdd-46a2-8b44-6638bd614147 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7" returned: 0 in 0.326s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:36 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 is being set with open permissions: ugo+rw Sep 25 18:13:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:36 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 Sep 25 18:13:36 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:36 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7" returned: 0 in 0.285s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:36 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info Sep 25 18:13:36 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:36 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:36 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info is being set with open permissions: ugo+rw Sep 25 18:13:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:36 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info Sep 25 18:13:36 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:37 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.info" returned: 0 in 0.280s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.110s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-quobyte-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6-ecb6fae6-d727-4f61-8023-3261c1e94608" by "_create_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6-ecb6fae6-d727-4f61-8023-3261c1e94608" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Creating volume ecb6fae6-d727-4f61-8023-3261c1e94608 from snapshot ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-quobyte-ecb6fae6-d727-4f61-8023-3261c1e94608" by "_copy_volume_from_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecb6fae6-d727-4f61-8023-3261c1e94608" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] snapshot: ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6, volume: ecb6fae6-d727-4f61-8023-3261c1e94608, {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 18:13:37 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1bb98297-5f6f-4c1f-99ac-a7ad4a4f22b0 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abe2b0f-8f5e-4d4a-90f9-8762f40ef8fe]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:37 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 Sep 25 18:13:37 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-6e5632a2-9737-4af1-b240-1d401bb68646 tempest-ProjectAdminTests-151277957 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2857971191406, 'free_capacity_gb': 1775.2857971191406, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86665) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 18:13:37 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07c89e40-6fea-4b05-90da-0454183d3285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85ece5-5c03-4586-addc-5d1a48a35297]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:37 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:37 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 Sep 25 18:13:37 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-2dcd06fc-4053-4f71-9599-c7063c5088a7-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2dcd06fc-4053-4f71-9599-c7063c5088a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-a70e6583-5fdd-46a2-8b44-6638bd614147" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-a70e6583-5fdd-46a2-8b44-6638bd614147" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-2dcd06fc-4053-4f71-9599-c7063c5088a7" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2dcd06fc-4053-4f71-9599-c7063c5088a7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 2dcd06fc-4053-4f71-9599-c7063c5088a7 of volume a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1e2377-548d-40d7-b77b-5418d3b48b21]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:38 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 Sep 25 18:13:38 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:38 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285" returned: 0 in 0.574s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Creating direct copy from snapshot {{(pid=86665) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.utils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Path /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 not found in is_blk_device check {{(pid=86665) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:38 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 Sep 25 18:13:38 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:38 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7" returned: 0 in 0.460s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a70e6583-5fdd-46a2-8b44-6638bd614147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[29335454-0772-46f4-8bff-c426a9ef5ac3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:38 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:38 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 Sep 25 18:13:38 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:39 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147" returned: 0 in 0.693s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:39 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:39 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 Sep 25 18:13:39 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:40 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7" returned: 0 in 0.947s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:40 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7 Sep 25 18:13:40 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:40 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:40 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147.2dcd06fc-4053-4f71-9599-c7063c5088a7" returned: 0 in 0.545s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2dcd06fc-4053-4f71-9599-c7063c5088a7" released by "_delete_snapshot" :: held 2.858s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-a70e6583-5fdd-46a2-8b44-6638bd614147" released by "delete_snapshot" :: held 2.914s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:41 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Created reservations ['ceb68a0b-1ed0-44ee-aff3-f5364ffa04c3', 'db0b8bd9-1939-4fd4-a8cf-c7e6fdf7917e', '364bf2c0-5c89-4e48-8296-2d21cbd82476', 'a5ceea10-f100-4b01-acff-7b3ab00f1f42'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:41 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:13:41 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d740506-d466-44c6-bfe7-6bd0116d34a0 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2dcd06fc-4053-4f71-9599-c7063c5088a7-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-a70e6583-5fdd-46a2-8b44-6638bd614147-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Lock "cinder-a70e6583-5fdd-46a2-8b44-6638bd614147-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-a70e6583-5fdd-46a2-8b44-6638bd614147" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:42 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-a70e6583-5fdd-46a2-8b44-6638bd614147" acquired by "delete_volume" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:42 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad82470-92d1-41f4-8a2b-f34d456e8fe5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:42 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:43 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 Sep 25 18:13:43 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:43 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147" returned: 0 in 0.755s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:43 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:43 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147 Sep 25 18:13:43 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:44 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-a70e6583-5fdd-46a2-8b44-6638bd614147" returned: 0 in 0.497s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-a70e6583-5fdd-46a2-8b44-6638bd614147" released by "delete_volume" :: held 1.442s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Created reservations ['75423095-657e-4269-a0a4-be28c3b7b3e7', '97130cec-a098-4c89-be2a-6edacc73ce9e', '0349cf29-c1d0-4002-8927-692cf907056c', 'e908d78b-4ee0-456a-a50d-4c7609f1fada'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:44 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:44 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:44 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:45 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:45 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.551s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:45 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:45 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:13:45 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-53622679-1a58-41db-a230-b2220c1b5252 tempest-ProjectMemberTests-279522478 None] Lock "cinder-a70e6583-5fdd-46a2-8b44-6638bd614147-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (50caaa72-9ae2-4f0d-be2f-7a0de3f49207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240bda57-caf0-40ae-889d-d8251cd9734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240bda57-caf0-40ae-889d-d8251cd9734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597830829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:46Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3eb4cb-4c57-4bfd-8ccf-fb1ab73b4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3eb4cb-4c57-4bfd-8ccf-fb1ab73b4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f771d38d-fe2a-418a-ae12-c250aae4a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f771d38d-fe2a-418a-ae12-c250aae4a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840', 'volume_name': 'volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7863a384-6ed9-480d-9289-1e3af0a1b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7863a384-6ed9-480d-9289-1e3af0a1b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7f65ee-d8fd-44c2-9913-84f103560e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Volume 9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840', 'volume_size': 1} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (e4255bf9-25fa-4bfa-80ae-8d33868231b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8695dec7-35e4-47e1-97b4-7a92b946f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8695dec7-35e4-47e1-97b4-7a92b946f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1926503754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97357b31-f56b-448f-8be9-f80714c5fda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:46Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8661fc21-87c3-4051-81c5-dacb210bf2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8661fc21-87c3-4051-81c5-dacb210bf2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7099a1ee-c094-473b-8f53-597b182a7d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7099a1ee-c094-473b-8f53-597b182a7d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97357b31-f56b-448f-8be9-f80714c5fda6', 'volume_name': 'volume-97357b31-f56b-448f-8be9-f80714c5fda6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f468d5d6-06d4-406d-a5bf-0c3843c1c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f468d5d6-06d4-406d-a5bf-0c3843c1c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f60157b-071b-4f9e-9d54-55a45252148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:46 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Volume 97357b31-f56b-448f-8be9-f80714c5fda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97357b31-f56b-448f-8be9-f80714c5fda6', 'volume_size': 1} Sep 25 18:13:46 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:47 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608" returned: 0 in 9.028s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Image conversion details: src /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285, size 1024.00 MB, duration 9.03 sec, destination /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 {{(pid=86665) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 18:13:47 devstack cinder-volume[86665]: INFO cinder.image.image_utils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Converted 1024.00 MB image at 113.41 MB/s Sep 25 18:13:47 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 is being set with open permissions: ugo+rw Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:47 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 Sep 25 18:13:47 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:47 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608" returned: 0 in 0.246s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecb6fae6-d727-4f61-8023-3261c1e94608" released by "_copy_volume_from_snapshot" :: held 10.371s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6-ecb6fae6-d727-4f61-8023-3261c1e94608" released by "_create_volume_from_snapshot" :: held 10.443s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.477s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597830829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:46Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Creating volume 9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:47 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:47 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 1073741824 Sep 25 18:13:47 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f6ba38-0b8b-478f-85ad-20a6b042dc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb6fae6-d727-4f61-8023-3261c1e94608', 'volume_size': 1, 'snapshot_id': 'ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6'}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da5535-a01d-42f3-9644-e95c10a86afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:47 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Volume volume-ecb6fae6-d727-4f61-8023-3261c1e94608 (ecb6fae6-d727-4f61-8023-3261c1e94608): created successfully Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da5535-a01d-42f3-9644-e95c10a86afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Flow 'volume_create_manager' (46ee11fd-d1d9-405d-8a31-d6ba732822c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:47 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b610f1a5-f93b-4718-8d12-ef323db45ed1 tempest-SnapshotDependencyTests-1993129742 None] Created volume successfully. Sep 25 18:13:48 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 1073741824" returned: 0 in 0.500s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-quobyte-07c89e40-6fea-4b05-90da-0454183d3285" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-07c89e40-6fea-4b05-90da-0454183d3285" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-quobyte-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Deleting offline snapshot ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 of volume 07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:48 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 Sep 25 18:13:48 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] snapshot_file for this snap is: volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb2fa6f-a45d-494d-afd2-e495d958dfce]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:48 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 Sep 25 18:13:48 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:48 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" returned: 0 in 0.280s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1926503754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97357b31-f56b-448f-8be9-f80714c5fda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:46Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Creating volume 97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:48 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:48 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 1073741824 Sep 25 18:13:48 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7f65ee-d8fd-44c2-9913-84f103560e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af23d59f-24fd-41ce-b95a-2b53f0160e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:48 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Volume volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 (9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840): created successfully Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af23d59f-24fd-41ce-b95a-2b53f0160e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (50caaa72-9ae2-4f0d-be2f-7a0de3f49207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-50f24670-24b3-498b-a604-80de96eab873 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:13:48 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" returned: 0 in 0.406s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07c89e40-6fea-4b05-90da-0454183d3285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd656a-fca4-40ff-aa12-b9249ba727b6]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:48 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 Sep 25 18:13:48 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:49 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 1073741824" returned: 0 in 0.497s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:49 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 Sep 25 18:13:49 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:49 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6" returned: 0 in 0.347s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.187s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f60157b-071b-4f9e-9d54-55a45252148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97357b31-f56b-448f-8be9-f80714c5fda6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78badc11-4230-463e-a2ea-b1bf5fb1ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Creating offline snapshot f25e4df9-e53d-4bf5-8037-2c005729e7c0 of volume 9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:49 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Volume volume-97357b31-f56b-448f-8be9-f80714c5fda6 (97357b31-f56b-448f-8be9-f80714c5fda6): created successfully Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78badc11-4230-463e-a2ea-b1bf5fb1ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:49 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (e4255bf9-25fa-4bfa-80ae-8d33868231b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1fab90-afa9-482b-a2c8-f729acaa9b92]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285" returned: 0 in 0.766s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ec65da30-fc81-47ba-90b6-6b510479607f tempest-ProjectReaderTests-1175174158 None] Created volume successfully. Sep 25 18:13:49 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 Sep 25 18:13:49 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:49 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 Sep 25 18:13:49 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (e8ffcf0a-238c-4729-bd90-5fdb538cee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1988de3-299e-4e95-b7b0-296e593d3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1988de3-299e-4e95-b7b0-296e593d3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942991069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb17a87-76fb-49ac-821e-5f7d1c4869a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:50Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b39703a-7de9-4cae-b2e9-fb119a6557a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b39703a-7de9-4cae-b2e9-fb119a6557a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e1dd31-beef-4188-b020-faa9a1151ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e1dd31-beef-4188-b020-faa9a1151ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb17a87-76fb-49ac-821e-5f7d1c4869a0', 'volume_name': 'volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607b0f61-73be-4fa3-aa6c-edca0b33f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607b0f61-73be-4fa3-aa6c-edca0b33f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1687567f-cc08-423b-b4ed-8921e337797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:49 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Volume feb17a87-76fb-49ac-821e-5f7d1c4869a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0', 'volume_size': 1} Sep 25 18:13:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:50 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" returned: 0 in 0.388s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:50 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" returned: 0 in 0.426s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:50 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6 Sep 25 18:13:50 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:50 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 1G Sep 25 18:13:50 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:50 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285.ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6" released by "_delete_snapshot" :: held 1.961s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-07c89e40-6fea-4b05-90da-0454183d3285" released by "delete_snapshot" :: held 1.997s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Created reservations ['9f6d33e7-851e-4011-85ee-01e19720abac', '9075ce10-5605-4865-9c16-e5e9c373c3b2', '52f1c42f-92eb-4904-8d93-35d16b92cd2e', '10f8139d-2314-498d-91bf-310cfe1b9b44'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:50 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Delete snapshot completed successfully. Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3c393d21-f5dc-4e20-8e72-ec1ba2492ab0 tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-ecd0a7b9-1061-4a27-b6fa-e9ca32a214e6-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:50 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 1G" returned: 0 in 0.488s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:50 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 Sep 25 18:13:50 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:50 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:50 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 is being set with open permissions: ugo+rw Sep 25 18:13:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:50 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 Sep 25 18:13:50 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:51 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0" returned: 0 in 0.246s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:51 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info Sep 25 18:13:51 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:51 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:51 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info is being set with open permissions: ugo+rw Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:51 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info Sep 25 18:13:51 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-07c89e40-6fea-4b05-90da-0454183d3285-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-07c89e40-6fea-4b05-90da-0454183d3285-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-quobyte-07c89e40-6fea-4b05-90da-0454183d3285" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-07c89e40-6fea-4b05-90da-0454183d3285" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:51 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.info" returned: 0 in 0.258s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64df2b3-1ba8-4529-a5d0-0711e12d63a1]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942991069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb17a87-76fb-49ac-821e-5f7d1c4869a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:50Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Creating volume feb17a87-76fb-49ac-821e-5f7d1c4869a0 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:51 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:51 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 1073741824 Sep 25 18:13:51 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a8bab278-4636-4014-86da-86c8452f08fb tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:13:51 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 Sep 25 18:13:51 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:52 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:52 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285" returned: 0 in 0.430s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 1073741824" returned: 0 in 0.455s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:52 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285 Sep 25 18:13:52 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:52 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 Sep 25 18:13:52 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:52 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-07c89e40-6fea-4b05-90da-0454183d3285" returned: 0 in 0.258s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-07c89e40-6fea-4b05-90da-0454183d3285" released by "delete_volume" :: held 0.796s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:52 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0" returned: 0 in 0.276s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Created reservations ['b8e21317-d850-4a72-a238-c024f04576de', '41ac8a8a-8ca5-4235-a789-3b748e6dc8ab', '4ade9af5-16ce-4e8f-ba34-e0b93aabe3c6', '69a8d5d2-61e0-4630-8a58-416239b2dc4f'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.750s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1687567f-cc08-423b-b4ed-8921e337797d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9272c99-eef0-4aed-8484-dfb79c50e20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Creating offline snapshot d80bbfa6-a252-4db9-910f-a13a9f1fbf31 of volume 97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:13:52 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Volume volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 (feb17a87-76fb-49ac-821e-5f7d1c4869a0): created successfully Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9272c99-eef0-4aed-8484-dfb79c50e20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (e8ffcf0a-238c-4729-bd90-5fdb538cee42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fbe62f-1832-4ed7-a72e-650153d594e8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-f25e4df9-e53d-4bf5-8037-2c005729e7c0-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e17b4c61-4bd5-4af5-adad-e572ad681fbd tempest-ProjectReaderTests-1736226515 None] Created volume successfully. Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Lock "cinder-f25e4df9-e53d-4bf5-8037-2c005729e7c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-f25e4df9-e53d-4bf5-8037-2c005729e7c0" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-f25e4df9-e53d-4bf5-8037-2c005729e7c0" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot f25e4df9-e53d-4bf5-8037-2c005729e7c0 of volume 9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:52 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:52 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:52 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 Sep 25 18:13:52 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43097d-e090-42bc-819c-6f1a4338998a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-ecb6fae6-d727-4f61-8023-3261c1e94608-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-ecb6fae6-d727-4f61-8023-3261c1e94608-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:52 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 Sep 25 18:13:52 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "cinder-quobyte-ecb6fae6-d727-4f61-8023-3261c1e94608" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecb6fae6-d727-4f61-8023-3261c1e94608" acquired by "delete_volume" :: waited 0.030s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f795d1-6b06-4220-9899-ddb51aafe34f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:52 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6" returned: 0 in 0.476s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.427s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:53 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 1G Sep 25 18:13:53 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Deleted volume successfully. Sep 25 18:13:53 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 Sep 25 18:13:53 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-22bfcbdc-6d79-4332-8d3f-1fe0e9f8be6c tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-07c89e40-6fea-4b05-90da-0454183d3285-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-feb17a87-76fb-49ac-821e-5f7d1c4869a0-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:53 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Lock "cinder-feb17a87-76fb-49ac-821e-5f7d1c4869a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0" returned: 0 in 0.546s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cbdd47-cd47-494d-96c0-2b0f9eb0ca3d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-quobyte-feb17a87-76fb-49ac-821e-5f7d1c4869a0" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-feb17a87-76fb-49ac-821e-5f7d1c4869a0" acquired by "delete_volume" :: waited 0.026s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb95da-cc99-4367-97bc-6b832f1e7c00]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608" returned: 0 in 0.508s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 Sep 25 18:13:53 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608 Sep 25 18:13:53 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 Sep 25 18:13:53 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 1G" returned: 0 in 0.594s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97357b31-f56b-448f-8be9-f80714c5fda6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97357b31-f56b-448f-8be9-f80714c5fda6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 Sep 25 18:13:53 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ecb6fae6-d727-4f61-8023-3261c1e94608" returned: 0 in 0.302s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-quobyte-ecb6fae6-d727-4f61-8023-3261c1e94608" released by "delete_volume" :: held 0.879s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:53 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" returned: 0 in 0.490s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0" returned: 0 in 0.430s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 Sep 25 18:13:53 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0 Sep 25 18:13:53 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Created reservations ['bce22eaf-072f-4737-ac4c-17a5f6f16908', '2ea97451-eec5-49d3-9115-53d627015c55', '4cf561a0-5cc4-44ae-bae0-3c4e8736d0db', '89e5a5b1-ce6b-4c49-be7f-d9fdcc6b215e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:53 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97357b31-f56b-448f-8be9-f80714c5fda6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31" returned: 0 in 0.390s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:53 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 is being set with open permissions: ugo+rw Sep 25 18:13:53 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:53 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 Sep 25 18:13:54 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:54 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:54 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:54 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-feb17a87-76fb-49ac-821e-5f7d1c4869a0" returned: 0 in 0.304s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-feb17a87-76fb-49ac-821e-5f7d1c4869a0" released by "delete_volume" :: held 0.793s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Created reservations ['f8a0e746-68c1-45ff-90e8-b0a5463cef02', 'e3d51f52-e9f9-4f8d-84e5-5b7e654432e0', 'c8e03c64-e1ba-4d05-af05-329244a957ce', '89f58e99-930d-489e-95d5-2c026200608a'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:54 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0" returned: 0 in 0.420s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:54 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31" returned: 0 in 0.271s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0 Sep 25 18:13:54 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:54 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info Sep 25 18:13:54 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:54 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:54 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.364s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Deleted volume successfully. Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ec74945-9ec8-4e22-b74e-1448d452da5f tempest-SnapshotDependencyTests-1993129742 None] Lock "cinder-ecb6fae6-d727-4f61-8023-3261c1e94608-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:54 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840.f25e4df9-e53d-4bf5-8037-2c005729e7c0" returned: 0 in 0.328s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-f25e4df9-e53d-4bf5-8037-2c005729e7c0" released by "_delete_snapshot" :: held 1.954s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" released by "delete_snapshot" :: held 2.014s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:54 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.317s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info" returned: 0 in 0.374s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:54 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info is being set with open permissions: ugo+rw Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Deleted volume successfully. Sep 25 18:13:54 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info Sep 25 18:13:54 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Created reservations ['b5e4c4d7-840e-48c0-8695-2344bafc1994', '17a9441f-334e-4dbc-b31a-d0386255c81e', '3be495b6-6198-4295-9ba0-ec90d4ed7e6f', '9f518b08-03b4-4664-9049-60ec9f7d9b16'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2dee5c43-59e1-488c-87f4-bc936d42d20c tempest-ProjectReaderTests-1736226515 None] Lock "cinder-feb17a87-76fb-49ac-821e-5f7d1c4869a0-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:54 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-b8d99689-3c03-4efd-aa1f-f52c5b14b660 tempest-ProjectMemberTests-279522478 None] Lock "cinder-f25e4df9-e53d-4bf5-8037-2c005729e7c0-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (65f0a9a7-6e81-4179-a317-5b121651a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ced34b8-5867-4b99-8f89-45d5671d7c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:54 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ced34b8-5867-4b99-8f89-45d5671d7c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603985764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e57e09c-c18c-4da3-864a-831bab071dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:55Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14438599-cac8-4aa0-82a8-dbde188f6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14438599-cac8-4aa0-82a8-dbde188f6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900d14d1-31f9-4496-99f0-85039a55e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900d14d1-31f9-4496-99f0-85039a55e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e57e09c-c18c-4da3-864a-831bab071dfb', 'volume_name': 'volume-8e57e09c-c18c-4da3-864a-831bab071dfb', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:55 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03347684-b298-4b80-a1e1-8896ca0b945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03347684-b298-4b80-a1e1-8896ca0b945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3785f91-d706-41cc-a6cc-42f8484bcd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:55 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Volume 8e57e09c-c18c-4da3-864a-831bab071dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e57e09c-c18c-4da3-864a-831bab071dfb', 'volume_size': 1} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.info" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603985764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e57e09c-c18c-4da3-864a-831bab071dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:55Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Creating volume 8e57e09c-c18c-4da3-864a-831bab071dfb {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:55 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:55 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb 1073741824 Sep 25 18:13:55 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:55 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-359d9641-96c9-4e8c-85d7-ae36628981ad tempest-ProjectReaderTests-1175174158 None] Create snapshot completed successfully Sep 25 18:13:55 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb 1073741824" returned: 0 in 0.473s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:55 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb Sep 25 18:13:55 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Lock "cinder-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:55 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd08fb-e474-49f2-b8d3-1f2c9b2ea40a]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb" returned: 0 in 0.395s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:55 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:55 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3785f91-d706-41cc-a6cc-42f8484bcd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e57e09c-c18c-4da3-864a-831bab071dfb', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c726c2ef-678b-4608-8164-e4de5e2339d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:56 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Volume volume-8e57e09c-c18c-4da3-864a-831bab071dfb (8e57e09c-c18c-4da3-864a-831bab071dfb): created successfully Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c726c2ef-678b-4608-8164-e4de5e2339d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (65f0a9a7-6e81-4179-a317-5b121651a586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:56 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-bf61b115-1788-4c21-a94e-99ce39102f00 tempest-ProjectReaderTests-1736226515 None] Created volume successfully. Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-d80bbfa6-a252-4db9-910f-a13a9f1fbf31-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:56 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-d80bbfa6-a252-4db9-910f-a13a9f1fbf31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-97357b31-f56b-448f-8be9-f80714c5fda6" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:56 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-97357b31-f56b-448f-8be9-f80714c5fda6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-d80bbfa6-a252-4db9-910f-a13a9f1fbf31" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-d80bbfa6-a252-4db9-910f-a13a9f1fbf31" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Deleting offline snapshot d80bbfa6-a252-4db9-910f-a13a9f1fbf31 of volume 97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] snapshot_file for this snap is: volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1094b6-2089-47c8-984f-71b25b57c8d9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:56 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.390s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:13:56 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 Sep 25 18:13:56 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:56 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" returned: 0 in 0.528s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:56 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840 Sep 25 18:13:56 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:56 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31" returned: 0 in 0.469s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97357b31-f56b-448f-8be9-f80714c5fda6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[310d198b-f2d0-406f-a4cf-4e652c5c9d37]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:56 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840" released by "delete_volume" :: held 0.927s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Created reservations ['9d819880-d43a-47f9-be7d-af23d1ca68f2', '0a0f70ef-a6ce-41ff-b9c4-5e53720303b1', '81d07e32-ef2e-42bd-a09b-5db6ca7bc064', '476ff7c4-8357-43fb-bcb1-bcee7d020a12'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:56 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 Sep 25 18:13:56 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:57 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:57 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-8e57e09c-c18c-4da3-864a-831bab071dfb-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Lock "cinder-8e57e09c-c18c-4da3-864a-831bab071dfb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:57 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-quobyte-8e57e09c-c18c-4da3-864a-831bab071dfb" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6" returned: 0 in 0.495s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:57 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-8e57e09c-c18c-4da3-864a-831bab071dfb" acquired by "delete_volume" :: waited 0.035s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:57 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[70404cde-b599-49b1-b7cd-097e5da0d0ed]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:57 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:57 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-e4617ef5-a286-468b-800d-60f4725ea5c2 tempest-ProjectMemberTests-279522478 None] Lock "cinder-9fd1a40c-9f0c-47c9-b1ee-cfc6bf7a0840-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:57 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb Sep 25 18:13:57 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:57 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31" returned: 0 in 0.357s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:57 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31 Sep 25 18:13:57 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:57 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb" returned: 0 in 0.409s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:57 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb Sep 25 18:13:57 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:57 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:57 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6.d80bbfa6-a252-4db9-910f-a13a9f1fbf31" returned: 0 in 0.321s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-d80bbfa6-a252-4db9-910f-a13a9f1fbf31" released by "_delete_snapshot" :: held 1.789s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-97357b31-f56b-448f-8be9-f80714c5fda6" released by "delete_snapshot" :: held 1.817s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:58 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-8e57e09c-c18c-4da3-864a-831bab071dfb" returned: 0 in 0.327s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Created reservations ['e33e033b-1de9-448d-8fc3-121cd0488c2d', 'a8ec0bb0-db98-41e1-9c89-6333cda9586a', '45c8559c-9adc-447d-8f61-c23d0497dab0', '5046930e-b7e4-4e3e-9318-b38ba3a33e54'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-8e57e09c-c18c-4da3-864a-831bab071dfb" released by "delete_volume" :: held 0.793s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Delete snapshot completed successfully. Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-6954f24a-56ab-459d-bdc8-771c2b959502 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-d80bbfa6-a252-4db9-910f-a13a9f1fbf31-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Created reservations ['09329b09-6ae7-4a3a-8702-e2e3adad778c', 'e3ac4423-dc02-4fb8-be18-53aa6045b0d7', '486198d0-9fbb-444f-8061-12175404099a', 'a58a14d9-5af8-4413-b85b-8a5980f1b84b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:58 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:58 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-97357b31-f56b-448f-8be9-f80714c5fda6-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Lock "cinder-97357b31-f56b-448f-8be9-f80714c5fda6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-97357b31-f56b-448f-8be9-f80714c5fda6" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:13:58 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-97357b31-f56b-448f-8be9-f80714c5fda6" acquired by "delete_volume" :: waited 0.017s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:13:58 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Deleted volume successfully. Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a7ea1-d2a6-429f-a3ac-8cbdd2ebd8b9]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (6e64d28b-3b46-4231-8ce2-47f996f949da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f564d7b-c2af-4236-b623-875d279ed934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-daca4aa5-5061-4a51-b482-67c938106e1a tempest-ProjectReaderTests-1736226515 None] Lock "cinder-8e57e09c-c18c-4da3-864a-831bab071dfb-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f564d7b-c2af-4236-b623-875d279ed934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045842332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcbc557-cf31-48a5-bbac-9d97eab3dda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:59Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3a588c-f42a-4ef8-bf89-48ebbcb872a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3a588c-f42a-4ef8-bf89-48ebbcb872a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8f1c91-2af3-40cf-8cb8-911995d68dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8f1c91-2af3-40cf-8cb8-911995d68dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcbc557-cf31-48a5-bbac-9d97eab3dda6', 'volume_name': 'volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a4961f-1913-4b1e-9b4c-5d0d85ade3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a4961f-1913-4b1e-9b4c-5d0d85ade3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7caf34ae-29ca-44b2-a71f-bc894af7c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:58 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Volume 5dcbc557-cf31-48a5-bbac-9d97eab3dda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6', 'volume_size': 1} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045842332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcbc557-cf31-48a5-bbac-9d97eab3dda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:59Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Creating volume 5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:58 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:58 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:58 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 1073741824 Sep 25 18:13:58 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:58 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 Sep 25 18:13:58 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (a08900f7-7516-4099-8ba1-ace9379f457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a323d95-d27a-4789-a4ac-5481f7cd7717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a323d95-d27a-4789-a4ac-5481f7cd7717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079218973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6b5f06-f69f-40d3-97dd-a27796426b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:59Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc35e16f-a385-4c4e-aec8-fa90b990bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc35e16f-a385-4c4e-aec8-fa90b990bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c62120-8b89-4118-9b53-a3c2c828c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c62120-8b89-4118-9b53-a3c2c828c004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6b5f06-f69f-40d3-97dd-a27796426b53', 'volume_name': 'volume-ab6b5f06-f69f-40d3-97dd-a27796426b53', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ec22b-820b-409c-a542-820879a2bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ec22b-820b-409c-a542-820879a2bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca0e20-13bb-401e-a376-589d821aad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Volume ab6b5f06-f69f-40d3-97dd-a27796426b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6b5f06-f69f-40d3-97dd-a27796426b53', 'volume_size': 1} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:59 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6" returned: 0 in 0.674s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:59 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6 Sep 25 18:13:59 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:59 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 1073741824" returned: 0 in 0.700s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:59 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 Sep 25 18:13:59 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:59 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-97357b31-f56b-448f-8be9-f80714c5fda6" returned: 0 in 0.308s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-97357b31-f56b-448f-8be9-f80714c5fda6" released by "delete_volume" :: held 1.090s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Created reservations ['81e271b8-b318-4efd-b22b-276df8086deb', '506cd558-447f-4c79-8f95-e458c806c2ab', '18b3dbc6-383b-4cad-941e-3fe33026ecb1', 'eff02981-47f0-4213-9610-422569456d79'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:59 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:13:59 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:59 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" returned: 0 in 0.341s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1079218973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6b5f06-f69f-40d3-97dd-a27796426b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:13:59Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Creating volume ab6b5f06-f69f-40d3-97dd-a27796426b53 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:13:59 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7caf34ae-29ca-44b2-a71f-bc894af7c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:13:59 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 1073741824 Sep 25 18:13:59 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c961d-d725-4a23-9449-4096f365909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:13:59 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:13:59 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Volume volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 (5dcbc557-cf31-48a5-bbac-9d97eab3dda6): created successfully Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c961d-d725-4a23-9449-4096f365909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (6e64d28b-3b46-4231-8ce2-47f996f949da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-089c1713-31ee-4f32-8770-120e7f0c4283 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:14:00 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.353s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Deleted volume successfully. Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cdd06262-4b33-40c8-9c36-93604b12730f tempest-ProjectReaderTests-1175174158 None] Lock "cinder-97357b31-f56b-448f-8be9-f80714c5fda6-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:00 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 1073741824" returned: 0 in 0.607s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:00 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 Sep 25 18:14:00 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:00 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53" returned: 0 in 0.298s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ca0e20-13bb-401e-a376-589d821aad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6b5f06-f69f-40d3-97dd-a27796426b53', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ff29af-0b97-4bb9-829b-8c87b5ef4ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:00 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Volume volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 (ab6b5f06-f69f-40d3-97dd-a27796426b53): created successfully Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ff29af-0b97-4bb9-829b-8c87b5ef4ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (a08900f7-7516-4099-8ba1-ace9379f457b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:00 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9b418967-fb13-401f-be27-c737693a19eb tempest-ProjectReaderTests-1736226515 None] Created volume successfully. Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:00 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec of volume 5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b1b8c7-b869-4ed1-acc2-d91c817ce05b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:01 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 Sep 25 18:14:01 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-ab6b5f06-f69f-40d3-97dd-a27796426b53-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-ab6b5f06-f69f-40d3-97dd-a27796426b53-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-quobyte-ab6b5f06-f69f-40d3-97dd-a27796426b53" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-ab6b5f06-f69f-40d3-97dd-a27796426b53" acquired by "delete_volume" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8fec9d-aafe-4cb1-8649-fce589e6cc36]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (adca0667-48cd-4070-b0be-bdac1c7d3b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fa932a-b690-4fff-b815-35d5e2dab51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fa932a-b690-4fff-b815-35d5e2dab51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143814127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7250918e-56ba-44ff-af29-ec5e048e5f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:01Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c530b93-9593-4338-982d-05ee9381736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c530b93-9593-4338-982d-05ee9381736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80735415-e04b-4fda-ad15-b9b5d8188296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80735415-e04b-4fda-ad15-b9b5d8188296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7250918e-56ba-44ff-af29-ec5e048e5f7d', 'volume_name': 'volume-7250918e-56ba-44ff-af29-ec5e048e5f7d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fc43bc-faac-4934-915c-c70281c55fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:01 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fc43bc-faac-4934-915c-c70281c55fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79207a7-adce-4308-9f54-d22113b0a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:01 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Volume 7250918e-56ba-44ff-af29-ec5e048e5f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7250918e-56ba-44ff-af29-ec5e048e5f7d', 'volume_size': 1} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" returned: 0 in 0.568s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:01 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 Sep 25 18:14:01 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:01 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec 1G Sep 25 18:14:01 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:01 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:01 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:01 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53 Sep 25 18:14:01 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:02 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec 1G" returned: 0 in 0.517s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:02 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec Sep 25 18:14:02 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:02 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-ab6b5f06-f69f-40d3-97dd-a27796426b53" returned: 0 in 0.334s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-ab6b5f06-f69f-40d3-97dd-a27796426b53" released by "delete_volume" :: held 0.825s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Created reservations ['3ffec296-a5c8-4615-bd89-c8fdf5f5753f', '96dbab70-c94e-42e4-877e-d7f836455713', 'c6f5ab5d-6b47-442e-8593-3436c890e6ec', 'bdd2e0d7-7630-4baf-b902-3700cfe29686'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:02 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" returned: 0 in 0.340s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:02 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec is being set with open permissions: ugo+rw Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:02 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:02 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:02 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec Sep 25 18:14:02 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:02 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.325s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:02 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Deleted volume successfully. Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-456e1eaa-ed8d-43f4-aba8-7761d87204f0 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-ab6b5f06-f69f-40d3-97dd-a27796426b53-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:02 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" returned: 0 in 0.378s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:02 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:02 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info Sep 25 18:14:02 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (b56fbb5f-b6ae-4c01-b31b-9ac3f956500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40a6a9a-d941-488a-9d5d-892097b0511c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40a6a9a-d941-488a-9d5d-892097b0511c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095753064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ab27ab-d33e-4c85-ab2e-3df97bfa5aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:03Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:03 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a1fa31-e91b-4e8a-8b6f-8266e6116e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a1fa31-e91b-4e8a-8b6f-8266e6116e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96587e8b-2639-4905-955a-7fe84d203008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96587e8b-2639-4905-955a-7fe84d203008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ab27ab-d33e-4c85-ab2e-3df97bfa5aee', 'volume_name': 'volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941f25dc-8e33-4323-8c92-3ec974648631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941f25dc-8e33-4323-8c92-3ec974648631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a81d7-f583-40e0-a71e-3a87e8870233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:03 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Volume 64ab27ab-d33e-4c85-ab2e-3df97bfa5aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee', 'volume_size': 1} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info" returned: 0 in 0.354s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:03 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info is being set with open permissions: ugo+rw Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:03 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info Sep 25 18:14:03 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:03 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.info" returned: 0 in 0.302s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143814127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7250918e-56ba-44ff-af29-ec5e048e5f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:01Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Creating volume 7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:03 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:03 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:03 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d 1073741824 Sep 25 18:14:03 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:03 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9b1a1336-cc74-4711-baff-9d7c721e8df7 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:14:04 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d 1073741824" returned: 0 in 0.479s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:04 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d Sep 25 18:14:04 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec of volume 5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccaba04-0534-44fa-a5e8-7cdef190d7ae]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:04 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec Sep 25 18:14:04 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:04 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d" returned: 0 in 0.318s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095753064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ab27ab-d33e-4c85-ab2e-3df97bfa5aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a618e818c3483d948e25ced6cd2956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:03Z,use_quota=True,user_id='cc6b0295b3ac4586910cb941e8269ee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Creating volume 64ab27ab-d33e-4c85-ab2e-3df97bfa5aee {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:04 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79207a7-adce-4308-9f54-d22113b0a498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7250918e-56ba-44ff-af29-ec5e048e5f7d', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:04 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee 1073741824 Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0911b8-5f50-4328-9913-84ef2249321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:04 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:04 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Volume volume-7250918e-56ba-44ff-af29-ec5e048e5f7d (7250918e-56ba-44ff-af29-ec5e048e5f7d): created successfully Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0911b8-5f50-4328-9913-84ef2249321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (adca0667-48cd-4070-b0be-bdac1c7d3b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:04 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-04f595a9-a92b-4eab-bba1-3a9722d1ab4f tempest-ProjectReaderTests-1175174158 None] Created volume successfully. Sep 25 18:14:04 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" returned: 0 in 0.394s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba600ad9-c927-4d15-be1e-3ccf4c177795]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:04 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:04 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 Sep 25 18:14:04 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:05 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee 1073741824" returned: 0 in 0.563s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:05 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee Sep 25 18:14:05 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:05 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" returned: 0 in 0.484s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:05 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec Sep 25 18:14:05 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:05 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee" returned: 0 in 0.301s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a81d7-f583-40e0-a71e-3a87e8870233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2e0cd5-1b88-49cd-99cf-406a4840adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:05 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Volume volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee (64ab27ab-d33e-4c85-ab2e-3df97bfa5aee): created successfully Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2e0cd5-1b88-49cd-99cf-406a4840adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Flow 'volume_create_manager' (b56fbb5f-b6ae-4c01-b31b-9ac3f956500b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:05 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-20bbb826-c6c6-4b1e-9819-0a4c1d182113 tempest-ProjectReaderTests-1736226515 None] Created volume successfully. Sep 25 18:14:05 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" returned: 0 in 0.418s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:05 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec Sep 25 18:14:05 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Creating offline snapshot 8e489a35-c1f2-47bb-a937-6631a5987328 of volume 7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc908f2-5bdb-4ded-bf91-287f9873199f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:05 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6.2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" returned: 0 in 0.315s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:05 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d Sep 25 18:14:05 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec" released by "_delete_snapshot" :: held 1.738s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:05 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" released by "delete_snapshot" :: held 1.766s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Created reservations ['eeac8991-f704-4600-9941-70da8445e0ab', '3b83ece6-8dd0-47a6-a1e8-fd2a5d49cfad', '7040f733-d190-4ecc-ade8-3bd572b48f33', 'ed270265-9f90-4d11-8083-5e28298fa51d'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:06 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-d14f14d0-5edd-4b9a-be07-30be27139c61 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2f88ae73-21c7-4a69-a4eb-0dab2bbd64ec-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:06 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d" returned: 0 in 0.477s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:06 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 1G Sep 25 18:14:06 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-5dcbc557-cf31-48a5-bbac-9d97eab3dda6-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Lock "cinder-5dcbc557-cf31-48a5-bbac-9d97eab3dda6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "cinder-quobyte-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee" acquired by "delete_volume" :: waited 0.042s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cee8b3-e1ce-45b4-a454-a2df9692e939]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" acquired by "delete_volume" :: waited 0.031s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[548dff66-ee7c-4404-8edb-c66b545d2dd3]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:06 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee Sep 25 18:14:06 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:06 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 Sep 25 18:14:06 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:06 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 1G" returned: 0 in 0.626s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:06 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7250918e-56ba-44ff-af29-ec5e048e5f7d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:06 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7250918e-56ba-44ff-af29-ec5e048e5f7d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 Sep 25 18:14:06 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee" returned: 0 in 0.484s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:07 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee Sep 25 18:14:07 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" returned: 0 in 0.463s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:07 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6 Sep 25 18:14:07 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7250918e-56ba-44ff-af29-ec5e048e5f7d -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328" returned: 0 in 0.467s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:07 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 is being set with open permissions: ugo+rw Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:07 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee" returned: 0 in 0.315s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:07 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 Sep 25 18:14:07 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-quobyte-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee" released by "delete_volume" :: held 0.870s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:07 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" returned: 0 in 0.311s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-5dcbc557-cf31-48a5-bbac-9d97eab3dda6" released by "delete_volume" :: held 0.858s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Created reservations ['99add06a-0834-449a-8c0e-2ed80dfcf6e9', 'e323c1d5-9f21-4743-a98c-256dfd236d51', '4241fc70-3a0b-4f0e-9c91-8dd0a82f47d3', '8877f9e5-faf9-4305-af8e-09c4818b0ddc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Created reservations ['32b6eac4-6ecd-4562-a13b-5d28d468ae69', '059361f9-3430-464f-8862-c5c0dbb732d9', 'ded0963a-20c4-4a01-8505-c22e48087e41', '060d9773-3fab-4164-90de-034145fc8b80'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:07 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:07 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:07 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328" returned: 0 in 0.369s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:07 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:07 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:07 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info Sep 25 18:14:07 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:07 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.322s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Deleted volume successfully. Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-1338a7a6-78e6-49af-9853-ee1b045d04c1 tempest-ProjectReaderTests-1736226515 None] Lock "cinder-64ab27ab-d33e-4c85-ab2e-3df97bfa5aee-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:08 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.309s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-f6b99559-9e25-4613-9452-241ba6561057 tempest-ProjectMemberTests-279522478 None] Lock "cinder-5dcbc557-cf31-48a5-bbac-9d97eab3dda6-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:08 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info" returned: 0 in 0.336s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:08 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info is being set with open permissions: ugo+rw Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:08 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info Sep 25 18:14:08 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:08 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.info" returned: 0 in 0.255s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:08 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-35784201-65aa-45a0-bf8f-e71fbbc4af8e tempest-ProjectReaderTests-1175174158 None] Create snapshot completed successfully Sep 25 18:14:08 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-8e489a35-c1f2-47bb-a937-6631a5987328-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Lock "cinder-8e489a35-c1f2-47bb-a937-6631a5987328-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-7250918e-56ba-44ff-af29-ec5e048e5f7d" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-7250918e-56ba-44ff-af29-ec5e048e5f7d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-8e489a35-c1f2-47bb-a937-6631a5987328" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-8e489a35-c1f2-47bb-a937-6631a5987328" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Deleting offline snapshot 8e489a35-c1f2-47bb-a937-6631a5987328 of volume 7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] snapshot_file for this snap is: volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2cc2de-4e40-42b4-801f-728d2ee238a0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:09 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 Sep 25 18:14:09 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (19ebbb82-45a3-49bb-82fd-cd790e0ad914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b89231d-743c-4570-818a-d9962d3d3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b89231d-743c-4570-818a-d9962d3d3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583500166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06756895-404a-4c4f-b573-961f517810cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:09Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db08421-8743-4376-8aba-271df3812865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db08421-8743-4376-8aba-271df3812865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea042828-91b8-493b-899b-5a27a7b0d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea042828-91b8-493b-899b-5a27a7b0d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06756895-404a-4c4f-b573-961f517810cb', 'volume_name': 'volume-06756895-404a-4c4f-b573-961f517810cb', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9f4f7f-d728-4af7-b662-c88946c6616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9f4f7f-d728-4af7-b662-c88946c6616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75c6c49-1a04-4284-9d69-ecfcb344c226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:09 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Volume 06756895-404a-4c4f-b573-961f517810cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06756895-404a-4c4f-b573-961f517810cb', 'volume_size': 1} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583500166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06756895-404a-4c4f-b573-961f517810cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:09Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Creating volume 06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:09 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:09 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb 1073741824 Sep 25 18:14:09 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:09 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328" returned: 0 in 0.432s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7250918e-56ba-44ff-af29-ec5e048e5f7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3728e5f1-cf3b-4d03-ae4a-4faec5a0a3fc]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:09 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d Sep 25 18:14:09 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:09 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb 1073741824" returned: 0 in 0.532s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:09 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:09 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb Sep 25 18:14:09 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:10 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d" returned: 0 in 0.444s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:10 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 Sep 25 18:14:10 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:10 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb" returned: 0 in 0.296s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75c6c49-1a04-4284-9d69-ecfcb344c226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06756895-404a-4c4f-b573-961f517810cb', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af372ce2-6656-4e03-9805-b6c88de5c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:10 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Volume volume-06756895-404a-4c4f-b573-961f517810cb (06756895-404a-4c4f-b573-961f517810cb): created successfully Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af372ce2-6656-4e03-9805-b6c88de5c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (19ebbb82-45a3-49bb-82fd-cd790e0ad914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cbb5ff95-0055-4a4c-8ab2-1266f6513129 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:14:10 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328" returned: 0 in 0.447s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:10 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328 Sep 25 18:14:10 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:10 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d.8e489a35-c1f2-47bb-a937-6631a5987328" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-8e489a35-c1f2-47bb-a937-6631a5987328" released by "_delete_snapshot" :: held 1.711s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-7250918e-56ba-44ff-af29-ec5e048e5f7d" released by "delete_snapshot" :: held 1.743s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Created reservations ['38a2989e-dbb8-4a7f-84e2-dd3fae844aee', '59da18e7-93f8-49e2-99dc-be7be14cccaa', 'a435d28f-fc6d-44e0-b428-9d699899e289', '89982dd9-1a51-454d-afe6-e9d6f2bb9b56'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:10 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Delete snapshot completed successfully. Sep 25 18:14:10 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-5608721e-c23a-43b8-8f60-a2a89665203b tempest-ProjectReaderTests-1175174158 None] Lock "cinder-8e489a35-c1f2-47bb-a937-6631a5987328-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-7250918e-56ba-44ff-af29-ec5e048e5f7d-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-7250918e-56ba-44ff-af29-ec5e048e5f7d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-7250918e-56ba-44ff-af29-ec5e048e5f7d" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-7250918e-56ba-44ff-af29-ec5e048e5f7d" acquired by "delete_volume" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0663d45-556a-4749-be56-dc364a4721ef]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:11 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d Sep 25 18:14:11 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot cccc910c-dba7-4223-971e-a58a18b4a1ac of volume 06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[27817b12-77af-40b6-a7a2-6f15876163af]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:11 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:11 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d" returned: 0 in 0.383s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:11 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:11 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d Sep 25 18:14:11 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:11 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb" returned: 0 in 0.376s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:11 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-7250918e-56ba-44ff-af29-ec5e048e5f7d" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:11 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac 1G Sep 25 18:14:11 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:11 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-7250918e-56ba-44ff-af29-ec5e048e5f7d" released by "delete_volume" :: held 0.733s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Created reservations ['bd4ac742-f565-42f9-af18-a40db5939d25', 'fd263fda-8d60-4e14-8ca1-598f0bd27508', 'df07bdb8-e9d4-4124-982f-19f77966ca4c', '7abc3880-7676-401c-99b7-1fe3723adcb4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:12 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:12 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:12 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.265s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:12 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Deleted volume successfully. Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-07021421-c28f-4969-8083-24fc65833df6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-7250918e-56ba-44ff-af29-ec5e048e5f7d-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:12 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac 1G" returned: 0 in 0.489s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06756895-404a-4c4f-b573-961f517810cb -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:12 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06756895-404a-4c4f-b573-961f517810cb -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac Sep 25 18:14:12 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:12 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06756895-404a-4c4f-b573-961f517810cb -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac" returned: 0 in 0.343s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:12 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac is being set with open permissions: ugo+rw Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:12 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac Sep 25 18:14:12 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (d2ee0f6f-1112-4487-b1f7-ab23659ba7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ecec6a-22fc-491c-976e-db435168e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ecec6a-22fc-491c-976e-db435168e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107832697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1fdda9-f213-45d3-9223-d32eeaea754e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:13Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b9d440-0e45-48cb-a44d-1190e532b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b9d440-0e45-48cb-a44d-1190e532b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f00e3f-3f07-43af-8173-4d241eabf91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f00e3f-3f07-43af-8173-4d241eabf91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1fdda9-f213-45d3-9223-d32eeaea754e', 'volume_name': 'volume-2b1fdda9-f213-45d3-9223-d32eeaea754e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44641dde-6bf6-4e74-8586-510fa0a3a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44641dde-6bf6-4e74-8586-510fa0a3a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56954512-e340-4f97-a59a-666c543f63b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:12 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Volume 2b1fdda9-f213-45d3-9223-d32eeaea754e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1fdda9-f213-45d3-9223-d32eeaea754e', 'volume_size': 1} Sep 25 18:14:12 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:13 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac" returned: 0 in 0.265s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:13 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info Sep 25 18:14:13 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:13 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:13 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info is being set with open permissions: ugo+rw Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:13 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info Sep 25 18:14:13 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:13 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.info" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107832697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1fdda9-f213-45d3-9223-d32eeaea754e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:13Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Creating volume 2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:13 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:13 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e 1073741824 Sep 25 18:14:13 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:13 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-7b35debc-7e6e-49ea-a8c9-0ca6e0920914 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:14:13 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:13 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e 1073741824" returned: 0 in 0.417s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:14 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e Sep 25 18:14:14 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:14 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=200,cinder:INSERT=70,cinder:UPDATE=245,cinder:DELETE=18 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56954512-e340-4f97-a59a-666c543f63b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1fdda9-f213-45d3-9223-d32eeaea754e', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b167086-6cb1-42c1-9dc9-345919f8aabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=192,cinder:INSERT=72,cinder:UPDATE=268,cinder:DELETE=26 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:14:14 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Volume volume-2b1fdda9-f213-45d3-9223-d32eeaea754e (2b1fdda9-f213-45d3-9223-d32eeaea754e): created successfully Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b167086-6cb1-42c1-9dc9-345919f8aabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (d2ee0f6f-1112-4487-b1f7-ab23659ba7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:14 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-61254593-69c0-4b92-82b4-89f8aab3a6f9 tempest-ProjectReaderTests-1175174158 None] Created volume successfully. Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-cccc910c-dba7-4223-971e-a58a18b4a1ac-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Lock "cinder-cccc910c-dba7-4223-971e-a58a18b4a1ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-06756895-404a-4c4f-b573-961f517810cb" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-06756895-404a-4c4f-b573-961f517810cb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-cccc910c-dba7-4223-971e-a58a18b4a1ac" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-cccc910c-dba7-4223-971e-a58a18b4a1ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot cccc910c-dba7-4223-971e-a58a18b4a1ac of volume 06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ea9724-49f7-4020-8ff4-38eaec525743]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:14 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:14 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac Sep 25 18:14:14 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Creating offline snapshot 905d72f7-cf18-4af4-98ef-7fd2eda101e0 of volume 2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d229a8-72c7-43f2-8b7e-e41c2df192af]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:15 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06756895-404a-4c4f-b573-961f517810cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:15 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e Sep 25 18:14:15 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da7444-af93-497d-bbc5-bdadfcb3f0b5]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:15 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb Sep 25 18:14:15 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:15 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:15 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 1G Sep 25 18:14:15 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:15 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb" returned: 0 in 0.395s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:15 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac Sep 25 18:14:15 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:15 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 1G" returned: 0 in 0.419s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1fdda9-f213-45d3-9223-d32eeaea754e -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:15 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1fdda9-f213-45d3-9223-d32eeaea754e -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 Sep 25 18:14:15 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:15 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac" returned: 0 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:15 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:15 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac Sep 25 18:14:15 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:16 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:16 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1fdda9-f213-45d3-9223-d32eeaea754e -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0" returned: 0 in 0.313s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:16 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 is being set with open permissions: ugo+rw Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb.cccc910c-dba7-4223-971e-a58a18b4a1ac" returned: 0 in 0.269s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:16 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 Sep 25 18:14:16 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-cccc910c-dba7-4223-971e-a58a18b4a1ac" released by "_delete_snapshot" :: held 1.532s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-06756895-404a-4c4f-b573-961f517810cb" released by "delete_snapshot" :: held 1.554s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Created reservations ['4f466fe8-44ef-4bd6-9561-fbbf688b3f37', '95b253f8-ab9b-4b4f-878e-2ba6d67d7ef3', 'be6cff19-b0df-479b-8925-ae8128d79e66', '82082a14-8325-45de-85e0-d8fcb63b96f4'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:16 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-479b8865-8aee-4a69-806a-ec34908abbcd tempest-ProjectMemberTests-279522478 None] Lock "cinder-cccc910c-dba7-4223-971e-a58a18b4a1ac-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:16 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:16 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info Sep 25 18:14:16 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:16 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:16 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info is being set with open permissions: ugo+rw Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:16 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info Sep 25 18:14:16 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-06756895-404a-4c4f-b573-961f517810cb-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Lock "cinder-06756895-404a-4c4f-b573-961f517810cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-06756895-404a-4c4f-b573-961f517810cb" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-06756895-404a-4c4f-b573-961f517810cb" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283c322-a2fa-49cb-a379-f83838e1e504]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:16 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:16 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.info" returned: 0 in 0.260s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:17 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-33360e28-b084-4b05-912b-9432cb4bfa83 tempest-ProjectReaderTests-1175174158 None] Create snapshot completed successfully Sep 25 18:14:17 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb Sep 25 18:14:17 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-905d72f7-cf18-4af4-98ef-7fd2eda101e0-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-905d72f7-cf18-4af4-98ef-7fd2eda101e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-2b1fdda9-f213-45d3-9223-d32eeaea754e" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-2b1fdda9-f213-45d3-9223-d32eeaea754e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-905d72f7-cf18-4af4-98ef-7fd2eda101e0" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-905d72f7-cf18-4af4-98ef-7fd2eda101e0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Deleting offline snapshot 905d72f7-cf18-4af4-98ef-7fd2eda101e0 of volume 2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] snapshot_file for this snap is: volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeebaff-6915-4fdb-acf2-34e671a109c8]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:17 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb" returned: 0 in 0.408s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:17 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb Sep 25 18:14:17 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:17 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 Sep 25 18:14:17 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:17 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-06756895-404a-4c4f-b573-961f517810cb" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-06756895-404a-4c4f-b573-961f517810cb" released by "delete_volume" :: held 0.720s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:17 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0" returned: 0 in 0.380s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1fdda9-f213-45d3-9223-d32eeaea754e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Created reservations ['9eb71b12-ef7a-46f3-9917-b13a8cc172d1', '2fe860cc-ed53-44ec-ba3c-32d1b61ee01a', '8d118ef3-3eba-452f-b2a7-5cc9a2700376', 'e07c7443-2ba0-4808-9c25-4c2396c88e92'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5d294e-9ed4-49d0-ba7e-75af56293445]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:17 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:17 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e Sep 25 18:14:17 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:17 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:17 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:18 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.288s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-223d5162-41a3-4bfc-8494-51931fb56158 tempest-ProjectMemberTests-279522478 None] Lock "cinder-06756895-404a-4c4f-b573-961f517810cb-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:18 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e" returned: 0 in 0.426s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:18 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 Sep 25 18:14:18 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (745b8ddc-49f7-46f6-b489-07c58cabc20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82c2fe7-dd59-4899-84fd-49f4a7739956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:18 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82c2fe7-dd59-4899-84fd-49f4a7739956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989756248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c817a88b-01db-4fd0-a668-ba5876c37384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:18Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37736308-8abe-4c62-bb04-6bb6a49e1ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37736308-8abe-4c62-bb04-6bb6a49e1ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073e44f3-4f2c-41a3-b199-e105676f4d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073e44f3-4f2c-41a3-b199-e105676f4d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c817a88b-01db-4fd0-a668-ba5876c37384', 'volume_name': 'volume-c817a88b-01db-4fd0-a668-ba5876c37384', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdea7c1-d6b5-4d44-9842-864904507911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdea7c1-d6b5-4d44-9842-864904507911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7234e4-a3bf-4b33-ba65-2e5ca9ab0c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:18 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Volume c817a88b-01db-4fd0-a668-ba5876c37384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c817a88b-01db-4fd0-a668-ba5876c37384', 'volume_size': 1} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989756248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c817a88b-01db-4fd0-a668-ba5876c37384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:18Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Creating volume c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:18 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0" returned: 0 in 0.451s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:18 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 1073741824 Sep 25 18:14:18 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:18 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0 Sep 25 18:14:18 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:18 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e.905d72f7-cf18-4af4-98ef-7fd2eda101e0" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-905d72f7-cf18-4af4-98ef-7fd2eda101e0" released by "_delete_snapshot" :: held 1.646s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-2b1fdda9-f213-45d3-9223-d32eeaea754e" released by "delete_snapshot" :: held 1.667s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Created reservations ['ce47506a-94ec-4d7b-8921-364e7d36967d', 'f32e2074-bde4-443d-b43e-0ed41d7c9996', 'fad378b3-d767-4834-9451-00a43b4d5808', '2923d55e-5aa1-48da-b44a-5aa0a4e57420'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:18 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Delete snapshot completed successfully. Sep 25 18:14:18 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-034cefa4-c22e-467c-8862-bb31d98eade6 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-905d72f7-cf18-4af4-98ef-7fd2eda101e0-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:19 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 1073741824" returned: 0 in 0.444s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:19 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 Sep 25 18:14:19 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:19 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384" returned: 0 in 0.249s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7234e4-a3bf-4b33-ba65-2e5ca9ab0c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c817a88b-01db-4fd0-a668-ba5876c37384', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46b9afc-e33f-4ab8-8116-11034a9912a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:19 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Volume volume-c817a88b-01db-4fd0-a668-ba5876c37384 (c817a88b-01db-4fd0-a668-ba5876c37384): created successfully Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46b9afc-e33f-4ab8-8116-11034a9912a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (745b8ddc-49f7-46f6-b489-07c58cabc20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-2b1fdda9-f213-45d3-9223-d32eeaea754e-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:19 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c5174cc2-9b17-4cb2-8be2-2c8080e61890 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Lock "cinder-2b1fdda9-f213-45d3-9223-d32eeaea754e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-2b1fdda9-f213-45d3-9223-d32eeaea754e" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-2b1fdda9-f213-45d3-9223-d32eeaea754e" acquired by "delete_volume" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3dcb3c-61fd-4f12-8d98-7c685ce1538f]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:19 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e Sep 25 18:14:19 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 2f513018-ec3b-4f70-ad16-688040c06c2e of volume c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70a1688-e24c-4fa2-8cf8-d6fe705e47a7]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:19 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 Sep 25 18:14:19 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:19 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e" returned: 0 in 0.374s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:19 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:19 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e Sep 25 18:14:19 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:20 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384" returned: 0 in 0.372s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:20 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e 1G Sep 25 18:14:20 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:20 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-2b1fdda9-f213-45d3-9223-d32eeaea754e" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-2b1fdda9-f213-45d3-9223-d32eeaea754e" released by "delete_volume" :: held 0.692s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Created reservations ['d9f2313a-4fd9-46ed-ba65-1d6610256a85', '65dc0b76-a9ff-456f-8d6f-061b2a5e1bfb', 'd0bf6b26-6307-4052-ae14-4484863bc3c1', 'e54cdfe2-82aa-48ce-b1a5-94991a52bf1a'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:20 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:20 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:20 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e 1G" returned: 0 in 0.443s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c817a88b-01db-4fd0-a668-ba5876c37384 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:20 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c817a88b-01db-4fd0-a668-ba5876c37384 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e Sep 25 18:14:20 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:20 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.294s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:20 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Deleted volume successfully. Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-a385077d-5e0d-4a98-92e5-b40e0085ef7d tempest-ProjectReaderTests-1175174158 None] Lock "cinder-2b1fdda9-f213-45d3-9223-d32eeaea754e-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:20 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c817a88b-01db-4fd0-a668-ba5876c37384 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e" returned: 0 in 0.342s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:20 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e is being set with open permissions: ugo+rw Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:20 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e Sep 25 18:14:20 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:20 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (83261419-a480-44ba-ab5b-817c7ff20e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a93429-780c-49c8-bb98-1e8865a9816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a93429-780c-49c8-bb98-1e8865a9816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977909034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d7100-5290-4561-b6e2-081b0548ddcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:21Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7842eba-074b-4656-ade7-2b0b0bf32fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7842eba-074b-4656-ade7-2b0b0bf32fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083b52fc-98fa-411f-a8cd-4c91fb14d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083b52fc-98fa-411f-a8cd-4c91fb14d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70d7100-5290-4561-b6e2-081b0548ddcd', 'volume_name': 'volume-f70d7100-5290-4561-b6e2-081b0548ddcd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628cc904-4a60-4e03-8de7-0a5ab3cff8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628cc904-4a60-4e03-8de7-0a5ab3cff8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a495985d-de13-4f54-acb4-04f936cbed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:21 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Volume f70d7100-5290-4561-b6e2-081b0548ddcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70d7100-5290-4561-b6e2-081b0548ddcd', 'volume_size': 1} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:21 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e" returned: 0 in 0.264s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:21 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info Sep 25 18:14:21 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:21 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:21 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info is being set with open permissions: ugo+rw Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:21 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info Sep 25 18:14:21 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:21 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.info" returned: 0 in 0.236s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977909034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d7100-5290-4561-b6e2-081b0548ddcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:21Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Creating volume f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:21 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:21 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:21 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd 1073741824 Sep 25 18:14:21 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:21 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-715e790f-6b1c-4027-b072-364e7c024ed7 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:14:22 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd 1073741824" returned: 0 in 0.442s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:22 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd Sep 25 18:14:22 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:22 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a495985d-de13-4f54-acb4-04f936cbed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70d7100-5290-4561-b6e2-081b0548ddcd', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268b51cf-5de0-40a7-a4c6-9bc2058596df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:22 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Volume volume-f70d7100-5290-4561-b6e2-081b0548ddcd (f70d7100-5290-4561-b6e2-081b0548ddcd): created successfully Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268b51cf-5de0-40a7-a4c6-9bc2058596df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (83261419-a480-44ba-ab5b-817c7ff20e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:22 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-aa9010da-c874-4581-a408-9e377688fefe tempest-ProjectReaderTests-1175174158 None] Created volume successfully. Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-2f513018-ec3b-4f70-ad16-688040c06c2e-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2f513018-ec3b-4f70-ad16-688040c06c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-c817a88b-01db-4fd0-a668-ba5876c37384" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-c817a88b-01db-4fd0-a668-ba5876c37384" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-2f513018-ec3b-4f70-ad16-688040c06c2e" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2f513018-ec3b-4f70-ad16-688040c06c2e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 2f513018-ec3b-4f70-ad16-688040c06c2e of volume c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43aefe2-dd60-4796-b9d7-863eae37f1a0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:22 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:23 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e Sep 25 18:14:23 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Creating offline snapshot 8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f of volume f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3146711c-7ee7-4b9e-8f49-6f4d7e009789]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:23 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e" returned: 0 in 0.398s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c817a88b-01db-4fd0-a668-ba5876c37384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f31045-45e0-4212-a5da-9d3b31e84728]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:23 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd Sep 25 18:14:23 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:23 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 Sep 25 18:14:23 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:23 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd" returned: 0 in 0.364s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:23 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f 1G Sep 25 18:14:23 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:23 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384" returned: 0 in 0.413s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:23 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:23 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e Sep 25 18:14:23 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:24 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f 1G" returned: 0 in 0.413s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70d7100-5290-4561-b6e2-081b0548ddcd -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:24 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e" returned: 0 in 0.349s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:24 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70d7100-5290-4561-b6e2-081b0548ddcd -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f Sep 25 18:14:24 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:24 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e Sep 25 18:14:24 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:24 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384.2f513018-ec3b-4f70-ad16-688040c06c2e" returned: 0 in 0.243s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:24 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f70d7100-5290-4561-b6e2-081b0548ddcd -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" returned: 0 in 0.298s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:24 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f is being set with open permissions: ugo+rw Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-2f513018-ec3b-4f70-ad16-688040c06c2e" released by "_delete_snapshot" :: held 1.518s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-c817a88b-01db-4fd0-a668-ba5876c37384" released by "delete_snapshot" :: held 1.542s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:24 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f Sep 25 18:14:24 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Created reservations ['e9a8fa20-0328-4925-a3b3-27b0e03fd5dc', '6708d2e4-ae96-4593-832d-49d589ffeffc', '34cae2e9-29e0-4df0-be37-729c65ec7603', '3537994c-c482-4846-a97e-aa3f16030867'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:24 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-123488de-c497-45f2-baa8-edd57465a597 tempest-ProjectMemberTests-279522478 None] Lock "cinder-2f513018-ec3b-4f70-ad16-688040c06c2e-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:24 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:24 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info Sep 25 18:14:24 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:24 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:24 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info is being set with open permissions: ugo+rw Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:24 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info Sep 25 18:14:24 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-c817a88b-01db-4fd0-a668-ba5876c37384-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:24 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Lock "cinder-c817a88b-01db-4fd0-a668-ba5876c37384-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-c817a88b-01db-4fd0-a668-ba5876c37384" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-c817a88b-01db-4fd0-a668-ba5876c37384" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aeeafc-6dc0-40ab-b321-7f2f1baf4f0e]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:25 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.info" returned: 0 in 0.266s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:25 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-93ee788d-e20a-41d9-960f-cb4275979778 tempest-ProjectReaderTests-1175174158 None] Create snapshot completed successfully Sep 25 18:14:25 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 Sep 25 18:14:25 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Lock "cinder-8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-f70d7100-5290-4561-b6e2-081b0548ddcd" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-f70d7100-5290-4561-b6e2-081b0548ddcd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Deleting offline snapshot 8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f of volume f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] snapshot_file for this snap is: volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:25 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384" returned: 0 in 0.393s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5327210-99f9-4988-a176-447c50f1ad49]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:25 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384 Sep 25 18:14:25 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:25 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f Sep 25 18:14:25 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:25 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-c817a88b-01db-4fd0-a668-ba5876c37384" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-c817a88b-01db-4fd0-a668-ba5876c37384" released by "delete_volume" :: held 0.699s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Created reservations ['a75187e0-b84a-490c-80c8-4c4c745bcfa4', 'a25ae468-fe51-49a1-a337-c0e3fa7f1668', '39367a08-b536-4502-8087-4153ee528f42', '8e44cc2c-d037-4fc9-adb2-7da54fb997fc'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:25 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" returned: 0 in 0.387s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f70d7100-5290-4561-b6e2-081b0548ddcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:25 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:25 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6de1d-1e43-4c87-adc3-87522b551f89]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:25 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:26 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd Sep 25 18:14:26 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:26 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.276s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:26 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-3d889096-afd4-48c2-88b0-b93825ce10b4 tempest-ProjectMemberTests-279522478 None] Lock "cinder-c817a88b-01db-4fd0-a668-ba5876c37384-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:26 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd" returned: 0 in 0.394s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:26 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f Sep 25 18:14:26 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (8dbf91bf-766d-4fc3-b2e5-553ca483a4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4a054f-210c-4a97-8186-419f34581c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4a054f-210c-4a97-8186-419f34581c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120350841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22594baa-b8f9-4e32-8583-8b35d4cf76e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:27Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eef68fd-5976-47b3-8076-7094065c748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eef68fd-5976-47b3-8076-7094065c748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa2e3db-4697-407f-b9b0-757e934d97f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa2e3db-4697-407f-b9b0-757e934d97f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22594baa-b8f9-4e32-8583-8b35d4cf76e6', 'volume_name': 'volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:26 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2363f8d-69bb-4323-a193-c0237722f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2363f8d-69bb-4323-a193-c0237722f14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdd5bed-5399-4662-9489-6e605e64f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:26 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Volume 22594baa-b8f9-4e32-8583-8b35d4cf76e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6', 'volume_size': 1} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120350841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22594baa-b8f9-4e32-8583-8b35d4cf76e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41660022b99e4b7c83bd03fd22df3137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:27Z,use_quota=True,user_id='a59c279e7f06415bac409e57d47c72a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Creating volume 22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:26 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" returned: 0 in 0.401s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:26 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 1073741824 Sep 25 18:14:26 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:26 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f Sep 25 18:14:26 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:26 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:26 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd.8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" returned: 0 in 0.267s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f" released by "_delete_snapshot" :: held 1.573s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-f70d7100-5290-4561-b6e2-081b0548ddcd" released by "delete_snapshot" :: held 1.599s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Created reservations ['6f628752-cda3-4f0f-ba91-3e8ce15fc055', '0b771669-0109-4475-a2bb-be661809e900', '9a908a8a-7c04-4855-8d3f-080c4df9578f', 'c739d6d9-52e0-4d53-9165-e71e5641d948'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Delete snapshot completed successfully. Sep 25 18:14:27 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-87956375-8abe-4a55-91b9-aa72a257b83e tempest-ProjectReaderTests-1175174158 None] Lock "cinder-8e537ef4-a047-4b52-ba0e-c7ca6c1bee2f-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 1073741824" returned: 0 in 0.450s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:27 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 Sep 25 18:14:27 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:27 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdd5bed-5399-4662-9489-6e605e64f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb748d0-3aca-44ec-b76e-8e09bbf454a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:27 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Volume volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 (22594baa-b8f9-4e32-8583-8b35d4cf76e6): created successfully Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb748d0-3aca-44ec-b76e-8e09bbf454a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Flow 'volume_create_manager' (8dbf91bf-766d-4fc3-b2e5-553ca483a4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:27 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-83d1ebb1-d564-4d7d-a8e7-393031c2c957 tempest-ProjectMemberTests-279522478 None] Created volume successfully. Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-f70d7100-5290-4561-b6e2-081b0548ddcd-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Lock "cinder-f70d7100-5290-4561-b6e2-081b0548ddcd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-f70d7100-5290-4561-b6e2-081b0548ddcd" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-f70d7100-5290-4561-b6e2-081b0548ddcd" acquired by "delete_volume" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[98566795-a1db-4a48-99a6-39ee2f5489b2]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Creating offline snapshot 3b848290-63d3-4b55-918e-0966a454140e of volume 22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:27 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd Sep 25 18:14:27 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f080f4f-d4de-4374-a03b-d6d921e5099b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:27 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:27 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 Sep 25 18:14:27 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:28 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd" returned: 0 in 0.383s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:28 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd Sep 25 18:14:28 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:28 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6" returned: 0 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:28 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e 1G Sep 25 18:14:28 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:28 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f70d7100-5290-4561-b6e2-081b0548ddcd" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-f70d7100-5290-4561-b6e2-081b0548ddcd" released by "delete_volume" :: held 0.712s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Created reservations ['675eb071-82d8-442d-940c-31f42c82af25', '6fcd77f3-622a-4588-a660-2444ce71dcd7', '26da8181-0903-4068-9b80-cd48823261d9', 'c73090fa-bf27-4636-9c40-92a28b31b822'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:28 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:28 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:28 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e 1G" returned: 0 in 0.419s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:28 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e Sep 25 18:14:28 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:28 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.262s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:28 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Deleted volume successfully. Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-ceb40103-fa5e-4ea7-aee6-d7e3701590fc tempest-ProjectReaderTests-1175174158 None] Lock "cinder-f70d7100-5290-4561-b6e2-081b0548ddcd-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:28 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e" returned: 0 in 0.305s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:28 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e is being set with open permissions: ugo+rw Sep 25 18:14:28 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:28 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e Sep 25 18:14:28 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:29 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (bc1e6040-00c5-4cd1-ba10-f15ab1af5afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f087cb04-4444-4f31-9dfe-314a8874ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e" returned: 0 in 0.289s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f087cb04-4444-4f31-9dfe-314a8874ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-294933557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fdfa6b-80e1-4b41-90d0-925c2eeb1f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:29Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98ce2fa-8f56-4c0f-ab34-96e5e2c0c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98ce2fa-8f56-4c0f-ab34-96e5e2c0c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ec536e-1953-436d-9141-89cbacc43a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ec536e-1953-436d-9141-89cbacc43a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fdfa6b-80e1-4b41-90d0-925c2eeb1f32', 'volume_name': 'volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461ae480-3174-4030-8ad6-e9bd782ce2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461ae480-3174-4030-8ad6-e9bd782ce2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14ecbf6-8019-4cfe-89f2-61af0fe14559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:29 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Volume 53fdfa6b-80e1-4b41-90d0-925c2eeb1f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32', 'volume_size': 1} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:29 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info Sep 25 18:14:29 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:29 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info" returned: 0 in 0.256s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:29 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info is being set with open permissions: ugo+rw Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:29 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info Sep 25 18:14:29 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:29 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.info" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-294933557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fdfa6b-80e1-4b41-90d0-925c2eeb1f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77ad429d894200b18af82eac8515e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:29Z,use_quota=True,user_id='c20a57ee35704ea4be48c390c8486d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Creating volume 53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:29 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:29 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:29 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 1073741824 Sep 25 18:14:29 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:29 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2b243c36-1bf6-4746-856d-84b3c7133cc6 tempest-ProjectMemberTests-279522478 None] Create snapshot completed successfully Sep 25 18:14:30 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 1073741824" returned: 0 in 0.417s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:30 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 Sep 25 18:14:30 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:30 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14ecbf6-8019-4cfe-89f2-61af0fe14559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e450b015-1ff1-4a04-99a0-4aa833ff2f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:30 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Volume volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 (53fdfa6b-80e1-4b41-90d0-925c2eeb1f32): created successfully Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e450b015-1ff1-4a04-99a0-4aa833ff2f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:30 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Flow 'volume_create_manager' (bc1e6040-00c5-4cd1-ba10-f15ab1af5afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:30 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-4c31e057-e171-49fb-85f6-5923cf19636c tempest-ProjectReaderTests-1175174158 None] Created volume successfully. Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-3b848290-63d3-4b55-918e-0966a454140e-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Lock "cinder-3b848290-63d3-4b55-918e-0966a454140e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-22594baa-b8f9-4e32-8583-8b35d4cf76e6" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-22594baa-b8f9-4e32-8583-8b35d4cf76e6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-3b848290-63d3-4b55-918e-0966a454140e" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-3b848290-63d3-4b55-918e-0966a454140e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Deleting offline snapshot 3b848290-63d3-4b55-918e-0966a454140e of volume 22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] snapshot_file for this snap is: volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f89e2e-53b5-4ac9-856f-8969219d02c0]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:31 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e Sep 25 18:14:31 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Creating offline snapshot 2069cee9-d1d6-4a46-9351-64787c46e3ad of volume 53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52783d2-8de8-4459-b363-5f0eff7710fb]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:31 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e" returned: 0 in 0.402s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de5a072-9674-4010-a367-4e7b085bf030]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:31 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 Sep 25 18:14:31 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:31 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 Sep 25 18:14:31 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:31 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" returned: 0 in 0.382s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad 1G {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:31 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad 1G Sep 25 18:14:31 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:31 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6" returned: 0 in 0.376s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:31 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e Sep 25 18:14:31 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:32 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad 1G" returned: 0 in 0.430s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:32 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad Sep 25 18:14:32 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:32 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e" returned: 0 in 0.377s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:32 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e Sep 25 18:14:32 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:32 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 -F qcow2 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad" returned: 0 in 0.292s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:32 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad is being set with open permissions: ugo+rw Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:32 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6.3b848290-63d3-4b55-918e-0966a454140e" returned: 0 in 0.254s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:32 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad Sep 25 18:14:32 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-3b848290-63d3-4b55-918e-0966a454140e" released by "_delete_snapshot" :: held 1.517s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-22594baa-b8f9-4e32-8583-8b35d4cf76e6" released by "delete_snapshot" :: held 1.538s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Created reservations ['89e3e6d6-2197-479e-b9e9-45e422dfd5f6', '1665a00a-8632-4a42-8d8b-7e6a1975ba3d', 'f8d7fb5c-b844-45fd-8384-1fe5a80261e3', 'ff2c83df-76ba-47a1-9bbc-1f4c5ea04e2e'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:32 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Delete snapshot completed successfully. Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-032aef5c-f0eb-41cf-817a-cecb88aaaadb tempest-ProjectMemberTests-279522478 None] Lock "cinder-3b848290-63d3-4b55-918e-0966a454140e-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:32 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad" returned: 0 in 0.241s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:32 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info Sep 25 18:14:32 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:33 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info" returned: 0 in 0.255s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:33 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.remotefs [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info is being set with open permissions: ugo+rw Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:33 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info Sep 25 18:14:33 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-22594baa-b8f9-4e32-8583-8b35d4cf76e6-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Lock "cinder-22594baa-b8f9-4e32-8583-8b35d4cf76e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Acquiring lock "cinder-quobyte-22594baa-b8f9-4e32-8583-8b35d4cf76e6" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-22594baa-b8f9-4e32-8583-8b35d4cf76e6" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:33 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c74689-01ed-4c3d-905b-0fd37773657d]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.info" returned: 0 in 0.264s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-c6175cc5-ec1d-4e30-8967-7a46951639cb tempest-ProjectReaderTests-1175174158 None] Create snapshot completed successfully Sep 25 18:14:33 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 Sep 25 18:14:33 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-2069cee9-d1d6-4a46-9351-64787c46e3ad-delete_snapshot" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Lock "cinder-2069cee9-d1d6-4a46-9351-64787c46e3ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" by "delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-2069cee9-d1d6-4a46-9351-64787c46e3ad" by "_delete_snapshot" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-2069cee9-d1d6-4a46-9351-64787c46e3ad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Deleting offline snapshot 2069cee9-d1d6-4a46-9351-64787c46e3ad of volume 53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] snapshot_file for this snap is: volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad {{(pid=86665) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31b7b38-292e-47e4-98cc-637cc8950089]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:33 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6" returned: 0 in 0.373s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:33 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6 Sep 25 18:14:33 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:33 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad Sep 25 18:14:33 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:33 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-22594baa-b8f9-4e32-8583-8b35d4cf76e6" returned: 0 in 0.251s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:33 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Lock "cinder-quobyte-22594baa-b8f9-4e32-8583-8b35d4cf76e6" released by "delete_volume" :: held 0.693s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:34 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad" returned: 0 in 0.397s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86665) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Created reservations ['d5eb882f-e596-4d68-bc5d-aa7af64a778c', '8e4a3c02-7e3d-40ef-86d6-eff2b0a445e3', 'a0935e9c-d8eb-45bd-93c2-5bb0e1b30f8b', '04e102e5-9dc8-4da1-a72d-216984e7e8df'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa52729-7648-4f28-9954-ae59d3ade819]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:34 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:34 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:34 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 Sep 25 18:14:34 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:34 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.271s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:34 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Deleted volume successfully. Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-86b59d25-6f55-454f-9019-5e4a85d59a1e tempest-ProjectMemberTests-279522478 None] Lock "cinder-22594baa-b8f9-4e32-8583-8b35d4cf76e6-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:34 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:34 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad Sep 25 18:14:34 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:34 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad" returned: 0 in 0.368s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:34 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:34 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad Sep 25 18:14:34 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:35 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32.2069cee9-d1d6-4a46-9351-64787c46e3ad" returned: 0 in 0.250s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-2069cee9-d1d6-4a46-9351-64787c46e3ad" released by "_delete_snapshot" :: held 1.519s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" released by "delete_snapshot" :: held 1.541s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Created reservations ['1512ce30-505e-4c1a-a481-6b8556a057f2', '181b6514-caf0-49e7-97b4-7fb856eb2244', 'b4a60ba5-c014-4901-8c7b-c24d06183a3b', 'f6fe065d-0e70-435a-9c5f-6bec3407a693'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:35 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Delete snapshot completed successfully. Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-9d7d7850-abe4-4fac-9077-74add9a346af tempest-ProjectReaderTests-1175174158 None] Lock "cinder-2069cee9-d1d6-4a46-9351-64787c46e3ad-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "cinder-quobyte-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" acquired by "delete_volume" :: waited 0.024s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e00f5e-63a3-4212-81ea-1fc7b50e913b]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:35 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:35 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 Sep 25 18:14:35 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:36 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" returned: 0 in 0.393s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:36 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32 Sep 25 18:14:36 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:36 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" returned: 0 in 0.265s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-quobyte-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32" released by "delete_volume" :: held 0.740s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Created reservations ['05084fa9-a9e8-47b6-a0dc-d6e995a47d3d', '10f997cc-f7e0-4840-a7eb-c5f005759c8a', '3c03b78c-8ee5-4f2b-99b0-65ecc243e51c', 'e60143eb-4d59-40a0-873c-2a259f25503b'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:36 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:36 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:36 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:36 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Deleted volume successfully. Sep 25 18:14:36 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-0509cf62-8df1-46bc-8d35-3d19c6c46d63 tempest-ProjectReaderTests-1175174158 None] Lock "cinder-53fdfa6b-80e1-4b41-90d0-925c2eeb1f32-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:46 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=102,cinder:SELECT=80,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:14:46 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:UPDATE=101,cinder:DELETE=8,cinder:SELECT=76,cinder:INSERT=32 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Flow 'volume_create_manager' (b3e1953a-4468-433a-96a1-bb8493703ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c835c2d-2c15-4498-968f-339b010c8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c835c2d-2c15-4498-968f-339b010c8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243755958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f888d4cc-17cd-4d42-a775-5c88da54f312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733b5a40cd954d3a85d55d19c03baa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:47Z,use_quota=True,user_id='4abbd49577c646f3838867c6dfe7dd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8780b3cc-75e8-4595-bbd9-5d5a6d1e453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8780b3cc-75e8-4595-bbd9-5d5a6d1e453d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476c7281-4a7e-4733-863c-3e97a7817a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476c7281-4a7e-4733-863c-3e97a7817a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f888d4cc-17cd-4d42-a775-5c88da54f312', 'volume_name': 'volume-f888d4cc-17cd-4d42-a775-5c88da54f312', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336a9793-933d-4c74-86a3-d0ad7ec82f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336a9793-933d-4c74-86a3-d0ad7ec82f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b6e2b6-8e27-4631-ac93-d45de98c0414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:47 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Volume f888d4cc-17cd-4d42-a775-5c88da54f312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f888d4cc-17cd-4d42-a775-5c88da54f312', 'volume_size': 1} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243755958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f888d4cc-17cd-4d42-a775-5c88da54f312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733b5a40cd954d3a85d55d19c03baa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:47Z,use_quota=True,user_id='4abbd49577c646f3838867c6dfe7dd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Creating volume f888d4cc-17cd-4d42-a775-5c88da54f312 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:47 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:47 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 1073741824 Sep 25 18:14:47 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:47 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:47 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 1073741824" returned: 0 in 0.407s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:48 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 Sep 25 18:14:48 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:48 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312" returned: 0 in 0.248s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b6e2b6-8e27-4631-ac93-d45de98c0414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f888d4cc-17cd-4d42-a775-5c88da54f312', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725f45cd-ee47-41c2-aa2c-96792dd439a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:48 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Volume volume-f888d4cc-17cd-4d42-a775-5c88da54f312 (f888d4cc-17cd-4d42-a775-5c88da54f312): created successfully Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725f45cd-ee47-41c2-aa2c-96792dd439a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Flow 'volume_create_manager' (b3e1953a-4468-433a-96a1-bb8493703ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:48 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-eb90af52-7288-4bf0-ae46-8eee6e7fd450 tempest-ProjectReaderTests-298534564 None] Created volume successfully. Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Acquiring lock "cinder-f888d4cc-17cd-4d42-a775-5c88da54f312-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Lock "cinder-f888d4cc-17cd-4d42-a775-5c88da54f312-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Acquiring lock "cinder-quobyte-f888d4cc-17cd-4d42-a775-5c88da54f312" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Lock "cinder-quobyte-f888d4cc-17cd-4d42-a775-5c88da54f312" acquired by "delete_volume" :: waited 0.014s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a51535-2294-404c-85b1-23316eab48af]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:48 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:48 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 Sep 25 18:14:48 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:49 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312" returned: 0 in 0.362s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:49 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312 Sep 25 18:14:49 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:49 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-f888d4cc-17cd-4d42-a775-5c88da54f312" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Lock "cinder-quobyte-f888d4cc-17cd-4d42-a775-5c88da54f312" released by "delete_volume" :: held 0.650s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Created reservations ['765684e6-fd0d-41de-943e-58d4a636c9e5', '7dcf119c-0872-4202-a744-5057a2b211f7', '36b3f67b-4c3a-4cd4-9f7e-57e8e0a9d6c3', '14f51f8c-ac9f-4681-8cb5-d4eead74bf60'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:49 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:49 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:49 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.237s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:49 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Deleted volume successfully. Sep 25 18:14:49 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-cc0f41e1-fa17-447c-821d-3e446e7eeee6 tempest-ProjectReaderTests-298534564 None] Lock "cinder-f888d4cc-17cd-4d42-a775-5c88da54f312-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86665) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Flow 'volume_create_manager' (74fde752-c015-4954-81e1-1d74a6bac512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d4b1f2-cb1b-4235-9fef-efef834a4c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d4b1f2-cb1b-4235-9fef-efef834a4c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24289816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5b7975-018f-495d-bcf1-13abd93f0d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733b5a40cd954d3a85d55d19c03baa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:50Z,use_quota=True,user_id='4abbd49577c646f3838867c6dfe7dd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905fd5ac-34a2-48d3-9b5a-4680505b27bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905fd5ac-34a2-48d3-9b5a-4680505b27bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71204e6-9ff7-4cfe-a376-5f0448925186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71204e6-9ff7-4cfe-a376-5f0448925186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5b7975-018f-495d-bcf1-13abd93f0d42', 'volume_name': 'volume-0b5b7975-018f-495d-bcf1-13abd93f0d42', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607c28a5-a8e9-4e3e-ab8e-f192c39afd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607c28a5-a8e9-4e3e-ab8e-f192c39afd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399b9833-4ae9-488c-8487-b253510c09a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:50 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Volume 0b5b7975-018f-495d-bcf1-13abd93f0d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5b7975-018f-495d-bcf1-13abd93f0d42', 'volume_size': 1} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24289816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5b7975-018f-495d-bcf1-13abd93f0d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733b5a40cd954d3a85d55d19c03baa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:14:50Z,use_quota=True,user_id='4abbd49577c646f3838867c6dfe7dd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba543683-898a-4588-9781-579e9704b920),volume_type_id=ba543683-898a-4588-9781-579e9704b920)}" {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Creating volume 0b5b7975-018f-495d-bcf1-13abd93f0d42 {{(pid=86665) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 as target Quobyte volume. {{(pid=86665) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 18:14:50 devstack cinder-volume[86665]: INFO cinder.volume.drivers.remotefs [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951 Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 1073741824 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:50 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 1073741824 Sep 25 18:14:50 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:50 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 1073741824" returned: 0 in 0.399s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:50 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:50 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 Sep 25 18:14:50 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:51 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42" returned: 0 in 0.244s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'} {{(pid=86665) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399b9833-4ae9-488c-8487-b253510c09a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5b7975-018f-495d-bcf1-13abd93f0d42', 'volume_size': 1}' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40d7b5-5afc-4340-af1e-145dba3db1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 18:14:51 devstack cinder-volume[86665]: INFO cinder.volume.flows.manager.create_volume [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Volume volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 (0b5b7975-018f-495d-bcf1-13abd93f0d42): created successfully Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40d7b5-5afc-4340-af1e-145dba3db1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86665) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Flow 'volume_create_manager' (74fde752-c015-4954-81e1-1d74a6bac512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86665) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 18:14:51 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-0f0ad420-d4e8-472d-8bc2-2af97e4c3410 tempest-ProjectReaderTests-298534564 None] Created volume successfully. Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Acquiring lock "cinder-0b5b7975-018f-495d-bcf1-13abd93f0d42-delete_volume" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Lock "cinder-0b5b7975-018f-495d-bcf1-13abd93f0d42-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Acquiring lock "cinder-quobyte-0b5b7975-018f-495d-bcf1-13abd93f0d42" by "delete_volume" {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Lock "cinder-quobyte-0b5b7975-018f-495d-bcf1-13abd93f0d42" acquired by "delete_volume" :: waited 0.015s {{(pid=86665) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6c262e-fbb9-47ee-9393-2f43387a19cd]: (4, 'qcow2') {{(pid=87932) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:51 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 Sep 25 18:14:51 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:51 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42" returned: 0 in 0.349s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:51 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:51 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42 Sep 25 18:14:51 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:52 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28/volume-0b5b7975-018f-495d-bcf1-13abd93f0d42" returned: 0 in 0.247s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Lock "cinder-quobyte-0b5b7975-018f-495d-bcf1-13abd93f0d42" released by "delete_volume" :: held 0.639s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG cinder.quota [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Created reservations ['ff2e9754-95ea-410f-9bbc-34d0cd15a22e', '5d75715e-7b48-4974-be24-4e9db6cf82da', '0e6d0647-bbde-49b5-bd38-ef725f80e138', '68c730e8-356a-4489-9388-3635fd2c7d17'] {{(pid=86665) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:52 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:52 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:52 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.245s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:52 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Deleted volume successfully. Sep 25 18:14:52 devstack cinder-volume[86665]: DEBUG cinder.coordination [None req-2ca54872-ff32-438c-ab64-cfcbc2bf2217 tempest-ProjectReaderTests-298534564 None] Lock "cinder-0b5b7975-018f-495d-bcf1-13abd93f0d42-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86665) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf315ae-a4bc-4df0-b751-9196fd548951'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 18:14:55 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 18:14:55 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28 Sep 25 18:14:55 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 18:14:56 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 25 18:14:56 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ec7502a1a7a1a55b29a97ca2e0065f28" returned: 0 in 0.239s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 18:14:56 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 18:14:56 devstack cinder-volume[86665]: DEBUG oslo_service.periodic_task [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] Running periodic task VolumeManager._thread_info {{(pid=86665) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 18:14:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread count: 28 {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 18:14:56 devstack cinder-volume[86665]: DEBUG cinder.volume.manager [None req-18bafb8d-0a02-4d1f-b1a6-fdcdd458dbac None None] thread info: [<_MainThread(MainThread, started 132872287993984)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86665) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 18:15:02 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=16,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 18:15:02 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writing DB stats cinder:SELECT=12,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}